binary_cross_entropy_with_logits

→Tensor

binary_cross_entropy_with_logits(x: Tensor, target: Tensor, weight: Tensor | None = None, pos_weight: Tensor | None = None, reduction: Reduction = 'mean')

source edit

Binary cross-entropy from raw logits (numerically stable).

Mathematically equivalent to binary_cross_entropy(sigmoid(x), target) but evaluated in a log-sum-exp-style form that avoids overflow/underflow when |x| is large. This is the preferred binary classification loss for training — composing a separate sigmoid with BCE risks catastrophic cancellation in $\log(1 - \sigma(x))$ for large positive logits.

Parameters

xTensor

Raw logits (un-bounded reals), any shape.

targetTensor

Target probabilities (typically binary), same shape as x — another shape raises ValueError rather than being broadcast.

weightTensor or None= None

Element-wise rescaling factor that broadcasts to x's shape; one that does not, or that would enlarge it, raises ValueError.

pos_weightTensor or None= None

Per-class weight applied to the positive term only — useful for highly-imbalanced binary tasks, where setting pos_weight = n_neg / n_pos recovers the prevalence- balanced gradient. It broadcasts to x's shape, as weight does.

reductionstr= 'mean'

"mean" (default), "sum", or "none".

Returns

Tensor

Scalar or full-shape per reduction.

Notes

The numerically stable form is

L_i = (1 - y_i)\,x_i + \operatorname{softplus}(-x_i),

equivalent to $-(y\log\sigma(x) + (1-y)\log(1-\sigma(x)))$ but free of overflow, and smooth at $x = 0$ (the $\max(x, 0) + \log(1 + e^{-|x|})$ spelling has the same value but a kink in each piece there). With pos_weight:

L_i = (1 - y_i)\,x_i + \big(1 + (w^{+} - 1) y_i\big)\operatorname{softplus}(-x_i).

Gradient w.r.t. x is the clean $\sigma(x_i) - y_i$ (modulo weighting) — the canonical reason this form is used in practice instead of the explicit sigmoid + BCE composition.

Examples

>>> import lucid
>>> from lucid.nn.functional import binary_cross_entropy_with_logits
>>> logits = lucid.tensor([2.0, -1.0, 0.5])
>>> target = lucid.tensor([1.0, 0.0, 1.0])
>>> binary_cross_entropy_with_logits(logits, target)
tensor(0.3048)

Used by 2

>>> import lucid >>> from lucid.nn.functional import binary_cross_entropy_with_logits >>> logits = lucid.tensor([2.0, -1.0, 0.5]) >>> target = lucid.tensor([1.0, 0.0, 1.0]) >>> binary_cross_entropy_with_logits(logits, target) tensor(0.3048)