Making sure we write the failed partition state before we try to recover #912

einari · 2023-07-27T11:47:33Z

Added

Adding support for appending many events at a time.
Centralized all projections and registering all; integration adapters, immediate projections and rule based.
Added persistence for all types of projections.
Introducing the concept of active vs non active projections. Active projections will automatically observe an event sequence, while an inactive (passive) will not. Immediate projections, rules or adapters fall into the category of passive projections.
Making it possible to use any projections for immediate projection by specifying the projection identifier you want to use.

Fixed

Added missing logging for when an observer invocation fails on the client.
Adding service registration for ITenantConfiguration to the client builder.
Fixing so that ValidFrom information is included on the Kernel receiver side when appending.
Optimizing performance for Importer by using the new AppendMany API.
A bug in the Kernel causing failed partition information not to be written to the event store immediately.
Projection sinks are now only created once per projection and sink type.
The engine representation of a Projection and its Pipeline is now managed by a manager and created only once per node.
Changed internal implementation of how we keep projections and pipeline definitions in sync across multiple silos when changed. Leveraging Broadcast channels.

github-actions · 2023-07-27T11:49:53Z

NuGet packages for this PR, e.g. Aksio.Cratis:
https://github.com/aksio-insurtech/Cratis/packages/1655206?version=9.0.2-pr912.591b740

github-actions · 2023-07-27T11:52:00Z

Docker Image for this PR:
https://ghcr.io/aksio-insurtech/cratis:9.0.2-pr912.591b740

docker run ghcr.io/aksio-insurtech/cratis:9.0.2-pr912.591b740

…inue on captured context

… sink type

github-actions · 2023-07-28T10:45:12Z

NuGet packages for this PR, e.g. Aksio.Cratis:
https://github.com/aksio-insurtech/Cratis/packages/1655206?version=9.0.2-pr912.f4e5329

github-actions · 2023-07-28T10:47:14Z

Docker Image for this PR:
https://ghcr.io/aksio-insurtech/cratis:9.0.2-pr912.f4e5329

docker run ghcr.io/aksio-insurtech/cratis:9.0.2-pr912.f4e5329

github-actions · 2023-07-28T18:06:24Z

NuGet packages for this PR, e.g. Aksio.Cratis:
https://github.com/aksio-insurtech/Cratis/packages/1655206?version=9.0.2-pr912.c1be953

github-actions · 2023-07-28T18:08:32Z

Docker Image for this PR:
https://ghcr.io/aksio-insurtech/cratis:9.0.2-pr912.c1be953

docker run ghcr.io/aksio-insurtech/cratis:9.0.2-pr912.c1be953

github-actions · 2023-07-28T18:14:20Z

NuGet packages for this PR, e.g. Aksio.Cratis:
https://github.com/aksio-insurtech/Cratis/packages/1655206?version=9.0.2-pr912.38f6c62

github-actions · 2023-07-28T18:16:57Z

Docker Image for this PR:
https://ghcr.io/aksio-insurtech/cratis:9.0.2-pr912.38f6c62

docker run ghcr.io/aksio-insurtech/cratis:9.0.2-pr912.38f6c62

github-actions · 2023-07-28T18:42:43Z

NuGet packages for this PR, e.g. Aksio.Cratis:
https://github.com/aksio-insurtech/Cratis/packages/1655206?version=9.0.2-pr912.5e9d4ec

github-actions · 2023-07-28T18:44:56Z

Docker Image for this PR:
https://ghcr.io/aksio-insurtech/cratis:9.0.2-pr912.5e9d4ec

docker run ghcr.io/aksio-insurtech/cratis:9.0.2-pr912.5e9d4ec

… per Silo

github-actions · 2023-07-31T12:18:35Z

NuGet packages for this PR, e.g. Aksio.Cratis:
https://github.com/aksio-insurtech/Cratis/packages/1655206?version=9.0.2-pr912.e0ce576

github-actions · 2023-07-31T12:19:09Z

Docker Image for this PR:
https://ghcr.io/aksio-insurtech/cratis:9.0.2-pr912.e0ce576

docker run ghcr.io/aksio-insurtech/cratis:9.0.2-pr912.e0ce576

…efinitions are changed This should give a serious performance boost

github-actions · 2023-08-02T07:23:09Z

Docker Image for this PR:
https://ghcr.io/aksio-insurtech/cratis:9.0.2-pr912.ee70950

docker run ghcr.io/aksio-insurtech/cratis:9.0.2-pr912.ee70950

…ting it

github-actions · 2023-08-02T10:54:06Z

Docker Image for this PR:
https://ghcr.io/aksio-insurtech/cratis:9.0.2-pr912.50079e4

docker run ghcr.io/aksio-insurtech/cratis:9.0.2-pr912.50079e4

github-actions · 2023-08-02T12:06:38Z

Docker Image for this PR:
https://ghcr.io/aksio-insurtech/cratis:9.0.2-pr912.42210d7

docker run ghcr.io/aksio-insurtech/cratis:9.0.2-pr912.42210d7

github-actions · 2023-08-10T08:44:01Z

Docker Image for this PR:
https://ghcr.io/aksio-insurtech/cratis:9.0.2-pr912.a9ff311

docker run ghcr.io/aksio-insurtech/cratis:9.0.2-pr912.a9ff311

…ncies it uses

github-actions · 2023-08-10T10:33:08Z

NuGet packages for this PR, e.g. Aksio.Cratis:
https://github.com/aksio-insurtech/Cratis/packages/1655206?version=9.0.2-pr912.10f29ae

github-actions · 2023-08-10T10:35:07Z

Docker Image for this PR:
https://ghcr.io/aksio-insurtech/cratis:9.0.2-pr912.10f29ae

docker run ghcr.io/aksio-insurtech/cratis:9.0.2-pr912.10f29ae

…ojections

…provider

github-actions · 2023-08-16T13:23:37Z

NuGet packages for this PR, e.g. Aksio.Cratis:
https://github.com/aksio-insurtech/Cratis/packages/1655206?version=9.0.2-pr912.f164070

github-actions · 2023-08-16T13:25:24Z

Docker Image for this PR:
https://ghcr.io/aksio-insurtech/cratis:9.0.2-pr912.f164070

docker run ghcr.io/aksio-insurtech/cratis:9.0.2-pr912.f164070

github-actions · 2023-08-16T13:49:38Z

NuGet packages for this PR, e.g. Aksio.Cratis:
https://github.com/aksio-insurtech/Cratis/packages/1655206?version=9.0.2-pr912.6fbc8e0

github-actions · 2023-08-16T13:52:17Z

Docker Image for this PR:
https://ghcr.io/aksio-insurtech/cratis:9.0.2-pr912.6fbc8e0

docker run ghcr.io/aksio-insurtech/cratis:9.0.2-pr912.6fbc8e0

einari added 3 commits July 27, 2023 10:44

Adding missing service collection registration for ITenantConfiguration

776f712

Adding client side logging for failed observer invocations

a46c52f

Making sure we write the failed partition state before we try to recover

f78daf9

einari added 4 commits July 27, 2023 14:21

Added support for appending many events to a sequence

856e820

Changing import operations to use the new AppendMany

5376d2a

Adding .ConfigureAwait(false) to all Db calls, as we want to not cont…

bbe0c9d

…inue on captured context

Making sure projection sinks are created only once per projection and…

24d8f91

… sink type

einari added the minor label Jul 28, 2023

einari added 2 commits July 28, 2023 19:38

Introducing a projection manager

9b403cd

Hooking up usage of IProjectionManager

1703636

Cleanup

0e33915

einari added 2 commits July 28, 2023 20:39

Register projection with manager on rehydrate

a763f80

Switching from creating projections to getting them from manager

ff19335

Up and running with Projections multi-microservice - stateless worker…

64a855c

… per Silo

All projection instances are now kept in memory and only changed if d…

e0bd7ef

…efinitions are changed This should give a serious performance boost

einari added 2 commits August 2, 2023 12:48

Adding functionality for checking for existence of projection and get…

0214092

…ting it

Only project if there actually is a projection defined

eacf361

Fixing specs after refactoring

50570e5

Renaming to reflect the rename of to connection from client

3a9fc43

einari added 2 commits August 10, 2023 10:35

Setting default solution to Cratis

7ab185b

Fixing code invalid according to static code analysis

fa5ee56

einari added 2 commits August 10, 2023 12:30

Making it testable by introducing a constructor for injecting depende…

8769ed8

…ncies it uses

Fixing specs to work against the modified provider

ed8dc3c

einari added 8 commits August 10, 2023 14:43

Changing from IEnumerable to IImmutableList for definitions

c9c4aaa

Renaming to ClientProjections and refactoring out the discovery of Pr…

279fdd0

…ojections

Adding specs for ClientProjections

6f7c2b7

Changing instantiation of projections to be done through the service …

18d06e2

…provider

Adding specs for projections

c09ff4f

Removing Console.WriteLine()

99bfeb6

Adding explicit using statement for correct IProjections

0ce7795

Removing unused execution context manager

da3f578

Adding specs to RulesProjections

a92db0e

einari marked this pull request as ready for review August 16, 2023 13:48

einari merged commit ce0c6c6 into main Aug 16, 2023
9 checks passed

einari deleted the fix/observers branch August 16, 2023 13:52

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Making sure we write the failed partition state before we try to recover #912

Making sure we write the failed partition state before we try to recover #912

einari commented Jul 27, 2023 •

edited

Loading

github-actions bot commented Jul 27, 2023

github-actions bot commented Jul 27, 2023

github-actions bot commented Jul 28, 2023

github-actions bot commented Jul 28, 2023

github-actions bot commented Jul 28, 2023

github-actions bot commented Jul 28, 2023

github-actions bot commented Jul 28, 2023

github-actions bot commented Jul 28, 2023

github-actions bot commented Jul 28, 2023

github-actions bot commented Jul 28, 2023

github-actions bot commented Jul 31, 2023

github-actions bot commented Jul 31, 2023

github-actions bot commented Aug 2, 2023

github-actions bot commented Aug 2, 2023

github-actions bot commented Aug 2, 2023

github-actions bot commented Aug 10, 2023

github-actions bot commented Aug 10, 2023

github-actions bot commented Aug 10, 2023

github-actions bot commented Aug 16, 2023

github-actions bot commented Aug 16, 2023

github-actions bot commented Aug 16, 2023

github-actions bot commented Aug 16, 2023

Making sure we write the failed partition state before we try to recover #912

Making sure we write the failed partition state before we try to recover #912

Conversation

einari commented Jul 27, 2023 • edited Loading

Added

Fixed

github-actions bot commented Jul 27, 2023

github-actions bot commented Jul 27, 2023

github-actions bot commented Jul 28, 2023

github-actions bot commented Jul 28, 2023

github-actions bot commented Jul 28, 2023

github-actions bot commented Jul 28, 2023

github-actions bot commented Jul 28, 2023

github-actions bot commented Jul 28, 2023

github-actions bot commented Jul 28, 2023

github-actions bot commented Jul 28, 2023

github-actions bot commented Jul 31, 2023

github-actions bot commented Jul 31, 2023

github-actions bot commented Aug 2, 2023

github-actions bot commented Aug 2, 2023

github-actions bot commented Aug 2, 2023

github-actions bot commented Aug 10, 2023

github-actions bot commented Aug 10, 2023

github-actions bot commented Aug 10, 2023

github-actions bot commented Aug 16, 2023

github-actions bot commented Aug 16, 2023

github-actions bot commented Aug 16, 2023

github-actions bot commented Aug 16, 2023

einari commented Jul 27, 2023 •

edited

Loading