Skip to content

Special Nodes

Vadim Mazalov edited this page Sep 16, 2016 · 5 revisions

CNTK uses Special nodes for automatic back propagation updates of Learnable Parameters and the proper inputs identification. Special nodes can be specified in two different ways:

  • Node arrays
  • Special Tags If both methods are used the values are combined.

Node Arrays

CNTK supports multiple nodes for each type, so the values in types are arrays. However in many there is only a single node for each node type. The array syntax (parenthesis) must be used when setting special nodes, even if there is only one element. If more than one element is included, the entries are comma separated and surrounded by parenthesis. For example:

FeatureNodes=(features)
LabelNodes=(labels)
CriterionNodes=(CrossEntropy)
EvalNodes=(ErrPredictOutputNodes, Plus2)
OutputNodes=(ScaledLogLikelihood)

Special Tags

You can use a special Optional Parameter named tag to easily identify special values in the network. For example:

F1=Input(SDim, tag=feature)
L1=Input(LDim, tag=label)

The table below contains acceptable tag names and their correspondence to the respective node types:

Tag name Meaning
feature feature input
label label input
criterion criterion node, top level node
eval evaluation node
output output node
Clone this wiki locally