Codebase to test Top-k Attention and Top-theta Attention on Large Language Models using the lm-eval-harness [1] framework, and text generation tasks including HumanEval [2] and LongBench [3] ...
Abstract: Complex or asymmetrical geometries can be difficult to model using ordinary, 1D, circuit modelling techniques. Simulating these geometries using 2D or 3D FDTD (Finite Difference Time Domain) ...