GH-37543: [C#][DRAFT] Implement support for Apache Acero

[davesearle]

Add support for Apache Acero.

Rationale for this change

I'm currently working on a project (in C#) that requires the ability to transform Arrow streams. The functionality provided by Acero is a good fit, however the current C# library does not support it. This PR looks to address that short coming. Given the potential size of these changes, I've opened a draft PR in case anyone else is looking to add support for Acero.

What changes are included in this PR?

• Implement support for the following source nodes:
  • record_batch_source
  • record_batch_reader_source
• Implement support for the following compute nodes:
  • filter
  • project
• Implement support for the following arrangement nodes:
  • hash_join
  • union
• Implement support for the following sink nodes:
  • sink

Are these changes tested?

Yes

Are there any user-facing changes?

• Closes: [C#] Implement support for Apache Acero #37543

[github-actions]

⚠️ GitHub issue #37543 has been automatically assigned in GitHub to PR creator.

[kou]

How about using small PRs instead of one large PR to support Acero?
For example, one PR for record_batch_source, one PR for filter and so on.
Small PRs are easier to review than one large PR.