Consider a softmax layer from Aditya Srinivas Menon's tutorial:
Apple, being a JIT compiler with shape types, is able to do a number of optimizations based on inferred dimension (and rank). Rank is almost always known in practice, so such optimizations are pertinent.
I just finished adding another mid-end to my Apple JIT compiler, motivated to get rank facilities right. However, there remain significant shortfalls.
Compilers and linkers put their own version information in ELF binaries; we can inspect
with readelf on the .comment section, to wit:
One PL nihilism is "all languages are the same." This is not so—general-purpose languages have converged on procedures, but languages that differ nontrivially are used in computing.
prev | next