3 Commits
Author SHA1 Message Date
b72eb44a31 Redundancy: bound the Raft log with the engine's snapshots (#4836)
# Description

**Draft: builds on #4835 and waits for a RaftCs release** containing
marcschier/raft-cs#9, marcschier/raft-cs#10 and marcschier/raft-cs#11,
anticipated as 1.1.4. It contains the commit of #4835; review only the
second commit.

`RaftSharedKeyValueStore` can capture and restore its state (#4794), but
`IRaftConsensus` carries no log indices, so the store cannot bound the
RaftCs log, which grows without limit. This change uses the engine's
snapshots:

- `IRaftSnapshotConsensus` (`CommittedItems` with log indices and
snapshots, `CompactAsync`) and `RaftCommittedItem`.
`DefaultRaftConsensus` implements it over `RaftNode.CommittedItems`,
`CreateSnapshotAsync` and `CompactAsync`.
- `RaftSharedKeyValueStore` gains a constructor overload with a
compaction interval and an optional logger (the existing constructors
are unchanged) and `AppliedIndex`. Over an `IRaftSnapshotConsensus` it
applies the indexed stream. A snapshot on that stream (a lagging replica
installing the leader's snapshot, or the first item after a restart)
replaces the state and publishes the differences to watchers. Every
compaction interval it snapshots its state into the engine, which
discards the log behind it. A compaction that fails is logged and
retried at the next interval.
- The engine snapshot is a format marker followed by the snapshot
encoding of #4794, so it carries the command position: the commands
after it keep the positions they have on every replica, and
`CreateSnapshotAsync`/`RestoreSnapshotAsync` keep working over it. No
compaction runs while a store restored with `FromFirstCommand` still
skips the replayed commands its snapshot holds.
- A snapshot in another format stops the applier. Pending and later
proposals and watches then fail with its error instead of waiting.
- `AppliedIndex` is published once the state holds an item, before
watchers and the proposer learn of it.
- Registration: `RedundancyConsistencyOptions.RaftCompactionInterval`
(server), and overloads of `AddRaftClientSharedStore` and
`AddRedundantClientSharedStore` that take the interval (client). Zero,
the default, never compacts. The store's logger comes from the
registered `ITelemetryContext`, else `ILoggerFactory`.
- `HighAvailability.md` describes the compaction and warns that a
replica must not be rolled back to a release without engine snapshots
once the cluster compacted its log.

No public member is removed or changed.

## Related Issues

- #4794 (store snapshots), #4835 (RaftCs 1.1.4)
- marcschier/raft-cs#9, marcschier/raft-cs#10, marcschier/raft-cs#11

## Checklist

- [x] I have signed the
[CLA](https://opcfoundation.org/license/cla/ContributorLicenseAgreementv1.0.pdf)
and read the
[CONTRIBUTING](https://github.com/OPCFoundation/UA-.NETStandard/blob/master/CONTRIBUTING.md)
doc.
- [x] I have added tests that prove my fix is effective or that my
feature works and increased code coverage.
(`RaftSharedKeyValueStoreCompactionTests`; registration tests in Server
and Client.)
- [x] I have added all necessary documentation.
- [x] I have verified that my changes do not introduce (new) build or
analyzer warnings.
- [ ] I ran **all** tests locally using the **UA.slnx** solution against
at least .net **framework** and .net **10**, and all passed. (Redundancy
test projects on .NET 10 against a RaftCs build of the three pull
requests: Server 935, Client 135, Kubernetes 103, PubSub 45, Samples 17,
all pass; the Server and Client test projects build for net48.)
- [ ] I fixed **all** failing and flaky tests in the CI pipelines and
**all** CodeQL warnings. (CI cannot restore RaftCs 1.1.4 until it is
released.)
- [x] I have addressed **all** PR feedback received.

---------

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Marc Schier <marcschier@users.noreply.github.com>
2026-10-20 14:48:20 +00:00
romanettandClaude Opus 5.5 9b034f8291 Enable nullable reference types centrally; migrate all unset and annotations-only projects (#4700)
# Description

Nullable reference types are now enabled once, in `common.props`, and
every project in the repository builds warning-clean with them.

**Configuration**
- `<Nullable>enable</Nullable>` lives in `common.props`. All per-project
`<Nullable>` settings are removed: 178 project files (enable,
annotations, and the `disable` in the three Aot test projects).
- 419 per-file `#nullable enable`/`restore` directives and the 4
`#nullable disable` directives are removed.
- Kept on purpose:
- The 5 `<auto-generated>` schema files (`UANodeSet.cs`, `UA Type
Dictionary.cs`, `OPCBinarySchema.cs`, `SecuredApplication.cs`,
`PInvokeHelper.cs`) keep `#nullable enable`. The compiler ignores the
project setting in generated code, so the directive is required there.
- `tests/Opc.Ua.Interop.LegacyPeer` keeps `disable`. It builds against
the 1.5.378 packages and does not import the repository props.
- `docs/DeveloperGuide.md` and `.github/copilot-instructions.md` now
describe the central setting.

**Migration** (the 43 unset and 13 annotations-only projects, roughly
10k diagnostics)
- **Production code: annotated at the declarations.** Covers
`tools/Opc.Ua.SourceGeneration.Core`, `src/Opc.Ua.Lds.Server` and the
LDS sample.
- Members, parameters and returns are nullable where null actually
flows.
- Null-check helpers carry `[NotNullWhen]` (`IsNull`, `IsValidXmlName`,
`IsMethodTypeDesign`).
- `CoreUtils.Format`, `Utils.Format`, `ITemplateWriter.WriteLine` take
`params object?[]`. `Template.AddReplacement` takes `string?` (rendering
already skips null replacements).
- `IRegisteredServerStore.RegisterAsync` returns
`Task<RegistrationEntry?>`: it returns null when a registration is
removed.
- Dereferences backed by an invariant (for example, the validated model)
use `!`, so runtime behaviour is unchanged.
- **Behavioural changes in production code** (small, deliberate):
- `NodeSetToModelDesign` throws `InvalidOperationException` when the
file is not a NodeSet. Before, it threw a NullReferenceException on the
next line.
- `ModelDesignValidator` starts its lookup tables empty instead of null.
A redundant `if (m_nodes == null) return;` guard is gone.
- **Test code: minimal annotations.**
  - `?` on values that can be null, `!` where the test asserts non-null.
  - `= null!` for fixture members assigned in SetUp.
- `TryGetStructure<T>(out T? x)` where the inferred `T?` broke the
`IEncodeable` constraint.
- A few redundant `== null` checks on structs (`NodeId`, `ArrayOf<T>`)
folded into the adjacent `IsNull`/`Count` checks.

**Notes for reviewers**
- The diff is large (~1,500 files) but almost entirely mechanical: `?`,
`!` and directive removal. The non-annotation changes are listed above.
- Known follow-up, not done here:
`IModelDesign.Namespaces/TargetNamespace/NamespaceUris` stay
non-nullable even though the validator returns null before it loads a
dictionary. Making them nullable would ripple through every generator
call site.

## Related Issues

- Fixes #4439

## Checklist

- [ ] I have signed the
[CLA](https://opcfoundation.org/license/cla/ContributorLicenseAgreementv1.0.pdf)
and read the
[CONTRIBUTING](https://github.com/OPCFoundation/UA-.NETStandard/blob/master/CONTRIBUTING.md)
doc.
- [ ] I have added tests that prove my fix is effective or that my
feature works and increased code coverage.
- [x] I have added all necessary documentation.
- [x] I have verified that my changes do not introduce (new) build or
analyzer warnings.
- [ ] I ran **all** tests locally using the **UA.slnx** solution against
at least .net **framework** and .net **10**, and all passed.
- [ ] I fixed **all** failing and flaky tests in the CI pipelines and
**all** CodeQL warnings.
- [ ] I have addressed **all** PR feedback received.

The "no new warnings" box covers net10.0 and net48: full non-incremental
builds of `UA.slnx`, `tools/SourceGeneration.slnx`,
`tools/MigrationAnalyzer.slnx` and the Aot test projects finished with 0
warnings and 0 errors under the repository's warnings-as-errors
settings. net9.0 and net8.0 also had no nullable diagnostics, but they
were not rebuilt after the final fixes. Tests have not been run locally
yet.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

---------

Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 08:48:13 +02:00
Marc Schier 7cec2d614d Move repository files to the consolidated layout 2026-07-16 06:25:54 +02:00