-
Notifications
You must be signed in to change notification settings - Fork 0
/
draft-ietf-bier-te-arch-12.txt
3808 lines (2532 loc) · 150 KB
/
draft-ietf-bier-te-arch-12.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
Network Working Group T. Eckert, Ed.
Internet-Draft Futurewei
Intended status: Standards Track M. Menth
Expires: July 5, 2022 University of Tuebingen
G. Cauchie
Bouygues Telecom
January 1, 2022
Tree Engineering for Bit Index Explicit Replication (BIER-TE)
draft-ietf-bier-te-arch-12
Abstract
This memo describes per-packet stateless strict and loose path
steered replication and forwarding for "Bit Index Explicit
Replication" (BIER, RFC8279) packets. It is called BIER Tree
Engineering (BIER-TE) and is intended to be used as the path steering
mechanism for Traffic Engineering with BIER.
BIER-TE introduces a new semantic for "bit positions" (BP). They
indicate adjacencies of the network topology, as opposed to (non-TE)
BIER in which BPs indicate "Bit-Forwarding Egress Routers" (BFER). A
BIER-TE packets BitString therefore indicates the edges of the (loop-
free) tree that the packet is forwarded across by BIER-TE. BIER-TE
can leverage BIER forwarding engines with little changes. Co-
existence of BIER and BIER-TE forwarding in the same domain is
possible, for example by using separate BIER "sub-domains" (SDs).
Except for the optional routed adjacencies, BIER-TE does not require
a BIER routing underlay, and can therefore operate without depending
on an "Interior Gateway Routing protocol" (IGP).
As it operates on the same per-packet stateless forwarding
principles, BIER-TE can also be a good fit to support multicast path
steering in "Segment Routing" (SR) networks.
Status of This Memo
This Internet-Draft is submitted in full conformance with the
provisions of BCP 78 and BCP 79.
Internet-Drafts are working documents of the Internet Engineering
Task Force (IETF). Note that other groups may also distribute
working documents as Internet-Drafts. The list of current Internet-
Drafts is at https://datatracker.ietf.org/drafts/current/.
Internet-Drafts are draft documents valid for a maximum of six months
and may be updated, replaced, or obsoleted by other documents at any
Eckert, et al. Expires July 5, 2022 [Page 1]
Internet-Draft BIER-TE ARCH January 2022
time. It is inappropriate to use Internet-Drafts as reference
material or to cite them other than as "work in progress."
This Internet-Draft will expire on July 5, 2022.
Copyright Notice
Copyright (c) 2022 IETF Trust and the persons identified as the
document authors. All rights reserved.
This document is subject to BCP 78 and the IETF Trust's Legal
Provisions Relating to IETF Documents
(https://trustee.ietf.org/license-info) in effect on the date of
publication of this document. Please review these documents
carefully, as they describe your rights and restrictions with respect
to this document. Code Components extracted from this document must
include Simplified BSD License text as described in Section 4.e of
the Trust Legal Provisions and are provided without warranty as
described in the Simplified BSD License.
Table of Contents
1. Overview . . . . . . . . . . . . . . . . . . . . . . . . . . 3
1.1. Requirements Language . . . . . . . . . . . . . . . . . . 5
2. Introduction . . . . . . . . . . . . . . . . . . . . . . . . 5
2.1. Basic Examples . . . . . . . . . . . . . . . . . . . . . 5
2.2. BIER-TE Topology and adjacencies . . . . . . . . . . . . 8
2.3. Relationship to BIER . . . . . . . . . . . . . . . . . . 9
2.4. Accelerated/Hardware forwarding comparison . . . . . . . 11
3. Components . . . . . . . . . . . . . . . . . . . . . . . . . 11
3.1. The Multicast Flow Overlay . . . . . . . . . . . . . . . 12
3.2. The BIER-TE Control Plane . . . . . . . . . . . . . . . . 12
3.2.1. The BIER-TE Controller . . . . . . . . . . . . . . . 14
3.2.1.1. BIER-TE Topology discovery and creation . . . . . 14
3.2.1.2. Engineered Trees via BitStrings . . . . . . . . . 15
3.2.1.3. Changes in the network topology . . . . . . . . . 15
3.2.1.4. Link/Node Failures and Recovery . . . . . . . . . 16
3.3. The BIER-TE Forwarding Plane . . . . . . . . . . . . . . 16
3.4. The Routing Underlay . . . . . . . . . . . . . . . . . . 17
3.5. Traffic Engineering Considerations . . . . . . . . . . . 17
4. BIER-TE Forwarding . . . . . . . . . . . . . . . . . . . . . 18
4.1. The BIER-TE Bit Index Forwarding Table (BIFT) . . . . . . 18
4.2. Adjacency Types . . . . . . . . . . . . . . . . . . . . . 21
4.2.1. Forward Connected . . . . . . . . . . . . . . . . . . 21
4.2.2. Forward Routed . . . . . . . . . . . . . . . . . . . 21
4.2.3. ECMP . . . . . . . . . . . . . . . . . . . . . . . . 21
4.2.4. Local Decap(sulation) . . . . . . . . . . . . . . . . 22
4.3. Encapsulation / Co-existence with BIER . . . . . . . . . 22
Eckert, et al. Expires July 5, 2022 [Page 2]
Internet-Draft BIER-TE ARCH January 2022
4.4. BIER-TE Forwarding Pseudocode . . . . . . . . . . . . . . 23
4.5. Basic BIER-TE Forwarding Example . . . . . . . . . . . . 27
4.6. BFR Requirements for BIER-TE forwarding . . . . . . . . . 30
5. BIER-TE Controller Operational Considerations . . . . . . . . 30
5.1. Bit Position Assignments . . . . . . . . . . . . . . . . 30
5.1.1. P2P Links . . . . . . . . . . . . . . . . . . . . . . 31
5.1.2. BFER . . . . . . . . . . . . . . . . . . . . . . . . 31
5.1.3. Leaf BFERs . . . . . . . . . . . . . . . . . . . . . 31
5.1.4. LANs . . . . . . . . . . . . . . . . . . . . . . . . 32
5.1.5. Hub and Spoke . . . . . . . . . . . . . . . . . . . . 33
5.1.6. Rings . . . . . . . . . . . . . . . . . . . . . . . . 33
5.1.7. Equal Cost MultiPath (ECMP) . . . . . . . . . . . . . 34
5.1.8. Forward Routed adjacencies . . . . . . . . . . . . . 37
5.1.8.1. Reducing bit positions . . . . . . . . . . . . . 37
5.1.8.2. Supporting nodes without BIER-TE . . . . . . . . 38
5.1.9. Reuse of bit positions (without DNC) . . . . . . . . 38
5.1.10. Summary of BP optimizations . . . . . . . . . . . . . 40
5.2. Avoiding duplicates and loops . . . . . . . . . . . . . . 41
5.2.1. Loops . . . . . . . . . . . . . . . . . . . . . . . . 41
5.2.2. Duplicates . . . . . . . . . . . . . . . . . . . . . 41
5.3. Managing SI, sub-domains and BFR-ids . . . . . . . . . . 42
5.3.1. Why SI and sub-domains . . . . . . . . . . . . . . . 42
5.3.2. Assigning bits for the BIER-TE topology . . . . . . . 43
5.3.3. Assigning BFR-id with BIER-TE . . . . . . . . . . . . 44
5.3.4. Mapping from BFR to BitStrings with BIER-TE . . . . . 45
5.3.5. Assigning BFR-ids for BIER-TE . . . . . . . . . . . . 46
5.3.6. Example bit allocations . . . . . . . . . . . . . . . 46
5.3.6.1. With BIER . . . . . . . . . . . . . . . . . . . . 46
5.3.6.2. With BIER-TE . . . . . . . . . . . . . . . . . . 47
5.3.7. Summary . . . . . . . . . . . . . . . . . . . . . . . 48
6. Security Considerations . . . . . . . . . . . . . . . . . . . 49
7. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 51
8. Acknowledgements . . . . . . . . . . . . . . . . . . . . . . 51
9. Change log [RFC Editor: Please remove] . . . . . . . . . . . 51
10. References . . . . . . . . . . . . . . . . . . . . . . . . . 64
10.1. Normative References . . . . . . . . . . . . . . . . . . 64
10.2. Informative References . . . . . . . . . . . . . . . . . 64
Appendix A. BIER-TE and Segment Routing . . . . . . . . . . . . 67
Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 68
1. Overview
BIER-TE is based on the (non-TE) BIER architecture, terminology and
packet formats as described in [RFC8279] and [RFC8296]. This
document describes BIER-TE in the expectation that the reader is
familiar with these two documents.
Eckert, et al. Expires July 5, 2022 [Page 3]
Internet-Draft BIER-TE ARCH January 2022
BIER-TE introduces a new semantic for "bit positions" (BP). They
indicate adjacencies of the network topology, as opposed to (non-TE)
BIER in which BPs indicate "Bit-Forwarding Egress Routers" (BFER). A
BIER-TE packets BitString therefore indicates the edges of the (loop-
free) tree that the packet is forwarded across by BIER-TE. With
BIER-TE, the "Bit Index Forwarding Table" (BIFT) of each "Bit
Forwarding Router" (BFR) is only populated with BP that are adjacent
to the BFR in the BIER-TE Topology. Other BPs are empty in the BIFT.
The BFR replicate and forwards BIER packets to adjacent BPs that are
set in the packet. BPs are normally also cleared upon forwarding to
avoid duplicates and loops.
BIER-TE can leverage BIER forwarding engines with little or no
changes. It can also co-exist with BIER forwarding in the same
domain, for example by using separate BIER sub-domains. Except for
the optional routed adjacencies, BIER-TE does not require a BIER
routing underlay, and can therefore operate without depending on an
"Interior Gateway Routing protocol" (IGP).
As it operates on the same per-packet stateless forwarding
principles, BIER-TE can also be a good fit to support multicast path
steering in "Segment Routing" (SR) networks ([RFC8402]).
This document is structured as follows:
o Section 2 introduces BIER-TE with two forwarding examples,
followed by an introduction of the new concepts of the BIER-TE
(overlay) topology and finally a summary of the relationship
between BIER and BIER-TE and a discussion of accelerated hardware
forwarding.
o Section 3 describes the components of the BIER-TE architecture,
Flow overlay, BIER-TE layer with the BIER-TE control plane
(including the BIER-TE controller) and BIER-TE forwarding plane,
and the routing underlay.
o Section 4 specifies the behavior of the BIER-TE forwarding plane
with the different type of adjacencies and possible variations of
BIER-TE forwarding pseudocode, and finally the mandatory and
optional requirements.
o Section 5 describes operational considerations for the BIER-TE
controller, foremost how the BIER-TE controller can optimize the
use of BP by using specific type of BIER-TE adjacencies for
different type of topological situations, but also how to assign
bits to avoid loops and duplicates (which in BIER-TE does not come
for free), and finally how "Set Identifier" (SI), "sub-domain"
Eckert, et al. Expires July 5, 2022 [Page 4]
Internet-Draft BIER-TE ARCH January 2022
(SD) and BFR-ids can be managed by a BIER-TE controller, examples
and summary.
o Appendix A concludes the technology specific sections of the
document by further relating BIER-TE to SR.
Note that related work, [I-D.ietf-roll-ccast] uses Bloom filters
[Bloom70] to represent leaves or edges of the intended delivery tree.
Bloom filters in general can support larger trees/topologies with
fewer addressing bits than explicit BitStrings, but they introduce
the heuristic risk of false positives and cannot clear bits in the
BitString during forwarding to avoid loops. For these reasons, BIER-
TE uses explicit BitStrings like BIER. The explicit BitStrings of
BIER-TE can also be seen as a special type of Bloom filter, and this
is how related work [ICC] describes it.
1.1. Requirements Language
The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT",
"SHOULD", "SHOULD NOT", "RECOMMENDED", "NOT RECOMMENDED", "MAY", and
"OPTIONAL" in this document are to be interpreted as described in BCP
14 [RFC2119] [RFC8174] when, and only when, they appear in all
capitals, as shown here.
2. Introduction
2.1. Basic Examples
BIER-TE forwarding is best introduced with simple examples. These
examples use formal terms defined later in the document (Figure 4),
including forward_connected(), forward_routed() and local_decap().
Eckert, et al. Expires July 5, 2022 [Page 5]
Internet-Draft BIER-TE ARCH January 2022
BIER-TE Topology:
Diagram:
p5 p6
--- BFR3 ---
p3/ p13 \p7 p15
BFR1 ---- BFR2 BFR5 ----- BFR6
p1 p2 p4\ p14 /p10 p11 p12
--- BFR4 ---
p8 p9
(simplified) BIER-TE Bit Index Forwarding Tables (BIFT):
BFR1: p1 -> local_decap()
p2 -> forward_connected() to BFR2
BFR2: p1 -> forward_connected() to BFR1
p5 -> forward_connected() to BFR3
p8 -> forward_connected() to BFR4
BFR3: p3 -> forward_connected() to BFR2
p7 -> forward_connected() to BFR5
p13 -> local_decap()
BFR4: p4 -> forward_connected() to BFR2
p10 -> forward_connected() to BFR5
p14 -> local_decap()
BFR5: p6 -> forward_connected() to BFR3
p9 -> forward_connected() to BFR4
p12 -> forward_connected() to BFR6
BFR6: p11 -> forward_connected() to BFR5
p15 -> local_decap()
Figure 1: BIER-TE basic example
Consider the simple network in the above BIER-TE overview example
picture with 6 BFRs. p1...p15 are the bit positions used. All BFRs
can act as an ingress BFR (BFIR), BFR1, BFR3, BFR4 and BFR6 can also
be BFERs. Forward_connected() is the name for adjacencies that are
representing subnet adjacencies of the network. Local_decap() is the
name of the adjacency to decapsulate BIER-TE packets and pass their
payload to higher layer processing.
Eckert, et al. Expires July 5, 2022 [Page 6]
Internet-Draft BIER-TE ARCH January 2022
Assume a packet from BFR1 should be sent via BFR4 to BFR6. This
requires a BitString (p2,p8,p10,p12,p15). When this packet is
examined by BIER-TE on BFR1, the only bit position from the BitString
that is also set in the BIFT is p2. This will cause BFR1 to send the
only copy of the packet to BFR2. Similarly, BFR2 will forward to
BFR4 because of p8, BFR4 to BFR5 because of p10 and BFR5 to BFR6
because of p12. p15 finally makes BFR6 receive and decapsulate the
packet.
To send a copy to BFR6 via BFR4 and also a copy to BFR3, the
BitString needs to be (p2,p5,p8,p10,p12,p13,p15). When this packet
is examined by BFR2, p5 causes one copy to be sent to BFR3 and p8 one
copy to BFR4. When BFR3 receives the packet, p13 will cause it to
receive and decapsulate the packet.
If instead the BitString was (p2,p6,p8,p10,p12,p13,p15), the packet
would be copied by BFR5 towards BFR3 because of p6 instead of being
copied by BFR2 to BFR3 because of p5 in the prior case. This is
showing the ability of the shown BIER-TE Topology to make the traffic
pass across any possible path and be replicated where desired.
BIER-TE has various options to minimize BP assignments, many of which
are based on out-of-band knowledge about the required multicast
traffic paths and bandwidth consumption in the network, such as from
pre-deployment planning.
Figure 2 shows a modified example, in which Rtr2 and Rtr5 are assumed
not to support BIER-TE, so traffic has to be unicast encapsulated
across them. To emphasize non-L2, but routed/tunneled forwarding of
BIER-TE packets, these adjacencies are called "forward_routed".
Otherwise, there is no difference in their processing over the
aforementioned forward_connected() adjacencies.
In addition, bits are saved in the following example by assuming that
BFR1 only needs to be BFIR but not BFER or transit BFR.
Eckert, et al. Expires July 5, 2022 [Page 7]
Internet-Draft BIER-TE ARCH January 2022
BIER-TE Topology:
Diagram:
p1 p3 p7
....> BFR3 <.... p5
........ ........>
BFR1 (Rtr2) (Rtr5) BFR6
........ ........> p9
....> BFR4 <.... p6
p2 p4 p8
(simplified) BIER-TE Bit Index Forwarding Tables (BIFT):
BFR1: p1 -> forward_routed() to BFR3
p2 -> forward_routed() to BFR4
BFR3: p3 -> local_decap()
p5 -> forward_routed() to BFR6
BFR4: p4 -> local_decap()
p6 -> forward_routed() to BFR6
BFR6: p7 -> forward_routed() to BFR3
p8 -> forward_routed() to BFR4
p9 -> local_decap()
Figure 2: BIER-TE basic overlay example
To send a BIER-TE packet from BFR1 via BFR3 to be received by BFR6,
the BitString is (p1,p5,p9). From BFR1 via BFR4 to be received by
BFR6, the BitString is (p2,p6,p9). A packet from BFR1 to be received
by BFR3,BFR4 and from BFR3 to be received by BFR6 uses
(p1,p2,p3,p4,p5,p9). A packet from BFR1 to be received by BFR3,BFR4
and from BFR4 to be received by BFR6 uses (p1,p2,p3,p4,p6,p9). A
packet from BFR1 to be received by BFR4, and from BFR4 to be received
by BFR6 and from there to be received by BFR3 uses
(p2,p3,p4,p6,p7,p9). A packet from BFR1 to be received by BFR3, and
from BFR3 to be received by BFR6 there to be received by BFR4 uses
(p1,p3,p4,p5,p8,p9).
2.2. BIER-TE Topology and adjacencies
The key new component in BIER-TE compared to (non-TE) BIER is the
BIER-TE topology as introduced through the two examples in
Section 2.1. It is used to control where replication can or should
happen and how to minimize the required number of BP for adjacencies.
Eckert, et al. Expires July 5, 2022 [Page 8]
Internet-Draft BIER-TE ARCH January 2022
The BIER-TE Topology consists of the BIFTs of all the BFR and can
also be expressed as a directed graph where the edges are the
adjacencies between the BFRs labelled with the BP used for the
adjacency. Adjacencies are naturally unidirectional. BP can be
reused across multiple adjacencies as long as this does not lead to
undesired duplicates or loops as explained in Section 5.2.
If the BIER-TE topology represents (a subset of) the underlying
(layer 2) topology of the network as shown in the first example, this
may be called a "native" BIER-TE topology. A topology consisting
only of "forward_routed" adjacencies as shown in the second example
may be called an "overlay" BIER-TE topology. A BIER-TE topology with
both forward_connected() and forward_routed() adjacencies may be
called a "hybrid" BIER-TE topology.
2.3. Relationship to BIER
BIER-TE is designed so that its forwarding plane is a simple
extension to the (non-TE) BIER forwarding plane, hence allowing for
it to be added to BIER deployments where it can be beneficial.
BIER-TE is also intended as an option to expand the BIER architecture
into deployments where (non-TE) BIER may not be the best fit, such as
statically provisioned networks with needs for path steering but
without desire for distributed routing protocols.
1. BIER-TE inherits the following aspects from BIER unchanged:
1. The fundamental purpose of per-packet signaled replication
and delivery via a BitString.
2. The overall architecture consisting of three layers, flow
overlay, BIER(-TE) layer and routing underlay.
3. The supported encapsulations [RFC8296].
4. The semantic of all [RFC8296] header elements used by the
BIER-TE forwarding plane other than the semantic of the BP in
the BitString.
5. The BIER forwarding plane, except for how bits have to be
cleared during replication.
2. BIER-TE has the following key changes with respect to BIER:
1. In BIER, bits in the BitString of a BIER packet header
indicate a BFER and bits in the BIFT indicate the BIER
control plane calculated next-hop toward that BFER. In BIER-
Eckert, et al. Expires July 5, 2022 [Page 9]
Internet-Draft BIER-TE ARCH January 2022
TE, a bit in the BitString of a BIER packet header indicates
an adjacency in the BIER-TE topology, and only the BFR that
is the upstream of that adjacency has its BP populated with
the adjacency in its BIFT.
2. In BIER, the implied reference option for the core part of
the BIER layer control plane are the BIER extensions for
distributed routing protocols. This includes ISIS/OSPF
extensions for BIER, [RFC8401] and [RFC8444].
3. The reference option for the core part of the BIER-TE control
plane is the BIER-TE controller. Nevertheless, both the BIER
and BIER-TE BIFTs forwarding plane state could equally be
populated by any mechanism.
4. Assuming the reference options for the control plane, BIER-TE
replaces in-network autonomous path calculation by explicit
paths calculated by the BIER-TE controller.
3. The following elements/functions described in the BIER
architecture are not required by the BIER-TE architecture:
1. "Bit Index Routing Tables" (BIRTs) are not required on BFRs
for BIER-TE when using a BIER-TE controller because the
controller can directly populate the BIFTs. In BIER, BIRTs
are populated by the distributed routing protocol support for
BIER, allowing BFRs to populate their BIFTs locally from
their BIRTs. Other BIER-TE control plane or management plane
options may introduce requirements for BIRTs for BIER-TE
BFRs.
2. The BIER-TE layer forwarding plane does not require BFRs to
have a unique BP and therefore also no unique BFR-id. See
Section 5.1.3.
3. Identification of BFRs by the BIER-TE control plane is
outside the scope of this specification. Whereas the BIER
control plane uses BFR-ids in its BFR to BFR signaling, a
BIER-TE controller may choose any form of identification
deemed appropriate.
4. BIER-TE forwarding does not require the BFIR-id field of the
BIER packet header.
4. Co-existence of BIER and BIER-TE in the same network requires the
following:
Eckert, et al. Expires July 5, 2022 [Page 10]
Internet-Draft BIER-TE ARCH January 2022
1. The BIER/BIER-TE packet header needs to allow addressing both
BIER and BIER-TE BIFTs. Depending on the encapsulation
option, the same SD may or may not be reusable across BIER
and BIER-TE. See Section 4.3. In either case, a packet is
always only forwarded end-to-end via BIER or via BIER-TE
(ships in the nights forwarding).
2. BIER-TE deployments will have to assign BFR-ids to BFRs and
insert them into the BFIR-id field of BIER packet headers as
BIER does, whenever the deployment uses (unchanged)
components developed for BIER that use BFR-id, such as
multicast flow overlays or BIER layer control plane elements.
See also Section 5.3.3.
2.4. Accelerated/Hardware forwarding comparison
BIER-TE forwarding rules, especially the BitString parsing are
designed to be as close as possible to those of BIER in the
expectation that this eases the programming of BIER-TE forwarding
code and/or BIER-TE forwarding hardware on platforms supporting BIER.
The pseudocode in Section 4.4 shows how existing (non-TE) BIER/BIFT
forwarding can be modified to support the required BIER-TE forwarding
functionality (Section 4.6), by using BIER BIFT's "Forwarding Bit
Mask" (F-BM): Only the clearing of bits to avoid duplicate packets to
a BFR's neighbor is skipped in BIER-TE forwarding because it is not
necessary and could not be done when using BIER F-BM.
Whether to use BIER or BIER-TE forwarding is simply a choice of the
mode of the BIFT indicated by the packet (BIER or BIER-TE BIFT).
This is determined by the BFR configuration for the encapsulation,
see Section 4.3.
3. Components
BIER-TE can be thought of being constituted from the same three
layers as BIER: The "multicast flow overlay", the "BIER layer" and
the "routing underlay". The following picture also shows how the
"BIER layer" is constituted from the "BIER-TE forwarding plane" and
the "BIER-TE control plane" represent by the "BIER-TE Controller".
Eckert, et al. Expires July 5, 2022 [Page 11]
Internet-Draft BIER-TE ARCH January 2022
<------BGP/PIM----->
|<-IGMP/PIM-> multicast flow <-PIM/IGMP->|
overlay
BIER-TE [BIER-TE Controller] <=> [BIER-TE Topology]
control ^ ^ ^
plane / | \ BIER-TE control protocol
| | | e.g. YANG/NETCONF/RESTCONF
| | | PCEP/...
v v v
Src -> Rtr1 -> BFIR-----BFR-----BFER -> Rtr2 -> Rcvr
|<----------------->|
BIER-TE forwarding plane
|<- BIER-TE domain->|
|<--------------------->|
Routing underlay
Figure 3: BIER-TE architecture
3.1. The Multicast Flow Overlay
The Multicast Flow Overlay has the same role as described for BIER in
[RFC8279], Section 4.3. See also Section 3.2.1.2.
When a BIER-TE controller is used, then the signaling for the
Multicast Flow Overlay may also be preferred to operate through a
central point of control. For BGP based overlay flow services such
as "Multicast VPN Using BIER" ([RFC8556]) this can be achieved by
making the BIER-TE controller operate as a BGP Route Reflector
([RFC4456]) and combining it with signaling through BGP or a
different protocol for the BIER-TE controller calculated BitStrings.
See Section 3.2.1.2 and Section 5.3.4.
3.2. The BIER-TE Control Plane
In the (non-TE) BIER architecture [RFC8279], the BIER control plane
is not explicitly separated from the BIER forwarding plane, but
instead their functions are summarized together in Section 4.2.
Example standardized options for the BIER control plane include ISIS/
OSPF extensions for BIER, [RFC8401] and [RFC8444].
For BIER-TE, the control plane includes at minimum the following
functionality.
Eckert, et al. Expires July 5, 2022 [Page 12]
Internet-Draft BIER-TE ARCH January 2022
1. BIER-TE topology control: During initial provisioning of the
network and/or during modifications of its topology and/or
services, the protocols and/or procedures to establish BIER-TE
BIFTs:
1. Determine the desired BIER-TE topology for a BIER-TE sub-
domains: the native and/or overlay adjacencies that are
assigned to BPs. Topology discovery is discussed in
Section 3.2.1.1 and the various aspects of the BIER-TE
controllers determinations about the topology are discussed
throughout Section 5
2. Determine the per-BFR BIFT from the BIER-TE topology. This is
achieved by simply extracting the adjacencies of the BFR from
the BIER-TE topology and populating the BFRs BIFT with them.
3. Optionally assign BFR-ids to BFIRs for later insertion into
BIER headers on BFIRs as BFIR-id. Alternatively, BFIR-id in
BIER packet headers may be managed solely by the flow overlay
layer and/or be unused. This is discussed in Section 5.3.3.
4. Install/update the BIFTs into the BFRs and optionally BFR-ids
into BFIRs. This is discussed in Section 3.2.1.1.
2. BIER-TE tree control: During operations of the network,
protocols and/or procedures to support creation/change/removal of
overlay flows on BFIRs:
1. Process the BIER-TE requirements for the multicast overlay
flow: BFIR and BFERs of the flow as well as policies for the
path selection of the flow. This is discussed in Section 3.5.
2. Determine the BitStrings and optionally Entropy. This is
discussed in Section 3.2.1.2, Section 3.5 and Section 5.3.4.
3. Install state on the BFIR to impose the desired BIER packet
header(s) for packets of the overlay flow. Different aspects
of this and the next point are discussed throughout
Section 3.2.1 and in Section 4.3, but the main responsibility
of these two points is with the Multicast Flow Overlay
(Section 3.1), which is architecturally inherited from BIER.
4. Install the necessary state on the BFERs to decapsulate the
BIER packet header and properly dispatch its payload.
Eckert, et al. Expires July 5, 2022 [Page 13]
Internet-Draft BIER-TE ARCH January 2022
3.2.1. The BIER-TE Controller
[RFC-Editor: the following text has three references to anchors
topology-control, topology-control-1 and tree-control.
Unfortunately, XMLv2 does not offer any tagging that reasonable
references are generated (i had this problem already in RFCs last
year. Please make sure there are useful-to-read cross-references in
the RFC in these three places after you convert to XMLv3.]
This architecture describes the BIER-TE control plane as shown in
Figure 3 to consist of:
o A BIER-TE controller.
o BFR data-models and protocols to communicate between controller
and BFRs in support of BIER-TE topology control (Paragraph 1),
such as YANG/NETCONF/RESTCONF ([RFC7950]/[RFC6241]/[RFC8040]).
o BFR data-models and protocols to communicate between controller
and BFIR in support of BIER-TE tree control (Paragraph 2), such as
BIER-TE extensions for [RFC5440].
The single, centralized BIER-TE controller is used in this document
as reference option for the BIER-TE control plane but other options
are equally feasible. The BIER-TE control plane could equally be
implemented without automated configuration/protocols, by an operator
via CLI on the BFRs. In that case, operator configured local policy
on the BFIR would have to determine how to set the appropriate BIER
header fields. The BIER-TE control plane could also be decentralized
and/or distributed, but this document does not consider any
additional protocols and/or procedures which would then be necessary
to coordinate its (distributed/decentralized) entities to achieve the
above described functionality.
3.2.1.1. BIER-TE Topology discovery and creation
The first item of BIER-TE topology control (Paragraph 1) includes
network topology discovery and BIER-TE topology creation. The latter
describes the process by which a Controller determines which routers
are to be configured as BFRs and the adjacencies between them.
In statically managed networks, such as in industrial environments,
both discovery and creation can be a manual/offline process.
In other networks, topology discovery may rely on protocols including
extending a "Link-State-Protocol" based IGP into the BIER-TE
controller itself, [RFC7752] (BGP-LS) or [RFC8345] (YANG topology) as
Eckert, et al. Expires July 5, 2022 [Page 14]
Internet-Draft BIER-TE ARCH January 2022
well as BIER-TE specific methods, for example via
[I-D.ietf-bier-te-yang]. These options are non-exhaustive.
Dynamic creation of the BIER-TE topology can be as easy as mapping
the network topology 1:1 to the BIER-TE topology by assigning a BP
for every network subnet adjacency. In larger networks, it likely
involves more complex policy and optimization decisions including how
to minimize the number of BPs required and how to assign BPs across
different BitStrings to minimize the number of duplicate packets
across links when delivering an overlay flow to BFER using different
SIs/BitStrings. These topics are discussed in Section 5.
When the BIER-TE topology is determined, the BIER-TE Controller then
pushes the BitPositions/adjacencies to the BIFT of the BFRs. On each
BFR only those SI:BitPositions are populated that are adjacencies to
other BFRs in the BIER-TE topology.
Communications between the BIER-TE Controller and BFRs for both BIER-
TE topology control and BIER-TE tree control is ideally via
standardized protocols and data-models such as NETCONF/RESTCONF/YANG/
PCEP. Vendor-specific CLI on the BFRs is also an option (as in many
other SDN solutions lacking definition of standardized data models).
3.2.1.2. Engineered Trees via BitStrings
In BIER, the same set of BFER in a single sub-domain is always
encoded as the same BitString. In BIER-TE, the BitString used to
reach the same set of BFER in the same sub-domain can be different
for different overlay flows because the BitString encodes the paths
towards the BFER, so the BitStrings from different BFIR to the same
set of BFER will often be different. Likewise, the BitString from
the same BFIR to the same set of BFER can be different for different
overlay flows for policy reasons such as shortest path trees, Steiner
trees (minimum cost trees), diverse path trees for redundancy and so
on.
See also [I-D.ietf-bier-multicast-http-response] for an application
leveraging BIER-TE engineered trees.
3.2.1.3. Changes in the network topology
If the network topology changes (not failure based) so that
adjacencies that are assigned to bit positions are no longer needed,
the BIER-TE Controller can re-use those bit positions for new
adjacencies. First, these bit positions need to be removed from any
BFIR flow state and BFR BIFT state, then they can be repopulated,
first into BIFT and then into the BFIR.
Eckert, et al. Expires July 5, 2022 [Page 15]
Internet-Draft BIER-TE ARCH January 2022
3.2.1.4. Link/Node Failures and Recovery
When link or nodes fail or recover in the topology, BIER-TE could
quickly respond with FRR procedures such as [I-D.eckert-bier-te-frr],
the details of which are out of scope for this document. It can also
more slowly react by recalculating the BitStrings of affected
multicast flows. This reaction is slower than the FRR procedure
because the BIER-TE Controller needs to receive link/node up/down
indications, recalculate the desired BitStrings and push them down
into the BFIRs. With FRR, this is all performed locally on a BFR
receiving the adjacency up/down notification.
3.3. The BIER-TE Forwarding Plane
[RFC-editor Q: "is constituted from" / "consists of" / "composed
from..." ???]
The BIER-TE Forwarding Plane is constituted from the following
components:
1. On a BFIR, imposition of the BIER header for packets from overlay
flows. This is driven by a combination of state established by
the BIER-TE control plane and/or the multicast flow overlay as
explained in Section 3.1.
2. On BFRs (including BFIR and BFER), forwarding/replication of BIER
packets according to their SD, SI, "BitStringLength" (BSL),
BitString and optionally Entropy fields as explained in
Section 4. Processing of other BIER header fields such as DSCP
is outside the scope of this document.
3. On BFERs, removal of the BIER header and dispatching of the
payload according to state created by the BIER-TE control plane
and/or overlay layer.
When the BIER-TE Forwarding Plane receives a packet, it simply looks
up the bit positions that are set in the BitString of the packet in
the BIFT that was populated by the BIER-TE Controller. For every BP
that is set in the BitString, and that has one or more adjacencies in
the BIFT, a copy is made according to the type of adjacencies for
that BP in the BIFT. Before sending any copy, the BFR clears all BPs
in the BitString of the packet for which the BFR has one or more
adjacencies in the BIFT. Clearing these bits inhibits packets from
looping when the BitStrings erroneously includes a forwarding loop.
When a forward_connected() adjacency has the "DoNotClear" (DNC) flag
set, then this BP is re-set for the packet copied to that adjacency.
See Section 4.2.1.
Eckert, et al. Expires July 5, 2022 [Page 16]
Internet-Draft BIER-TE ARCH January 2022
3.4. The Routing Underlay
For forward_connected() adjacencies, BIER-TE is sending BIER packets
to directly connected BIER-TE neighbors as L2 (unicasted) BIER
packets without requiring a routing underlay. For forward_routed()
adjacencies, BIER-TE forwarding encapsulates a copy of the BIER
packet so that it can be delivered by the forwarding plane of the
routing underlay to the routable destination address indicated in the
adjacency. See Section 4.2.2 for the adjacency definition.
BIER relies on the routing underlay to calculate paths towards BFERs
and derive next-hop BFR adjacencies for those paths. This commonly
relies on BIER specific extensions to the routing protocols of the
routing underlay but may also be established by a controller. In
BIER-TE, the next-hops of a packet are determined by the BitString
through the BIER-TE Controller established adjacencies on the BFR for
the BPs of the BitString. There is thus no need for BFR specific
routing underlay extensions to forward BIER packets with BIER-TE
semantics.
Encapsulation parameters can be provisioned by the BIER-TE controller
into the forward_connected() or forward_routed() adjacencies directly
without relying on a routing underlay.
If the BFR intends to support FRR for BIER-TE, then the BIER-TE
forwarding plane needs to receive fast adjacency up/down
notifications: Link up/down or neighbor up/down, e.g. from BFD.
Providing these notifications is considered to be part of the routing
underlay in this document.
3.5. Traffic Engineering Considerations
Traffic Engineering ([I-D.ietf-teas-rfc3272bis]) provides performance
optimization of operational IP networks while utilizing network
resources economically and reliably. The key elements needed to
effect TE are policy, path steering and resource management. These
elements require support at the control/controller level and within
the forwarding plane.
Policy decisions are made within the BIER-TE control plane, i.e.,
within BIER-TE Controllers. Controllers use policy when composing
BitStrings and BFR BIFT state. The mapping of user/IP traffic to
specific BitStrings/BIER-TE flows is made based on policy. The
specific details of BIER-TE policies and how a controller uses them
are out of scope of this document.
Path steering is supported via the definition of a BitString.
BitStrings used in BIER-TE are composed based on policy and resource
Eckert, et al. Expires July 5, 2022 [Page 17]
Internet-Draft BIER-TE ARCH January 2022
management considerations. For example, when composing BIER-TE
BitStrings, a Controller must take into account the resources
available at each BFR and for each BP when it is providing
congestion-loss-free services such as Rate Controlled Service
Disciplines [RCSD94]. Resource availability could be provided for
example via routing protocol information, but may also be obtained
via a BIER-TE control protocol such as NETCONF or any other protocol
commonly used by a Controller to understand the resources of the
network it operates on. The resource usage of the BIER-TE traffic
admitted by the BIER-TE controller can be solely tracked on the BIER-
TE Controller based on local accounting as long as no
forward_routed() adjacencies are used (see Section 4.2.1 for the
definition of forward_routed() adjacencies). When forward_routed()
adjacencies are used, the paths selected by the underlying routing
protocol need to be tracked as well.
Resource management has implications on the forwarding plane beyond
the BIER-TE defined steering of packets. This includes allocation of
buffers to guarantee the worst case requirements of admitted RCSD
traffic and potentially policing and/or rate-shaping mechanisms,
typically done via various forms of queuing. This level of resource
control, while optional, is important in networks that wish to
support congestion management policies to control or regulate the
offered traffic to deliver different levels of service and alleviate
congestion problems, or those networks that wish to control latencies
experienced by specific traffic flows.
4. BIER-TE Forwarding
4.1. The BIER-TE Bit Index Forwarding Table (BIFT)
The BIER-TE BIFT is the equivalent to the BIER BIFT for (non-TE)
BIER. It exists on every BFR running BIER-TE. For every BIER sub-
domain (SD) in use for BIER-TE, it is a table as shown shown in
Figure 4. That example BIFT assumes a BSL of 8 bit positions (BPs)
in the packets BitString. As in [RFC8279] this BSL is purely used
for the example and not a BIER/BIER-TE supported BSL (minimum BSL is
64).
A BIER-TE BIFT compares to a BIER BIFT as shown in [RFC8279] as
follows.
In both BIER and BIER-TE, BIFT rows/entries are indexed in their
respective BIER pseudocode ([RFC8279] Section 6.5) and BIER-TE