You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
we don't want to wrap scalars into tensors if we don't need to. Scalars are easier to treat in a compiler than tensors, and often get extra optimisations (no memory allocations, no synchronisations when accessed if we are working on CUDA, you can specialise on them...)
Note that this applies in general, so we should be mindful about this going all across.
So far the approach is quite the opposite: convert everything so scalars become 0-dim tensors, and proceed with tensors. Special-casing scalars would make wrappers heavier so if this is something we are going to do, it needs to be done across the codebase indeed.
The text was updated successfully, but these errors were encountered:
Over at #51 (comment), @lezcano observes that
So far the approach is quite the opposite: convert everything so scalars become 0-dim tensors, and proceed with tensors. Special-casing scalars would make wrappers heavier so if this is something we are going to do, it needs to be done across the codebase indeed.
The text was updated successfully, but these errors were encountered: