HiLo-Token allocates more tokens to high-frequency, context-rich regions and fewer tokens to low-frequency regions for DiT-based image editing, reducing serving costs by one-third without quality regression.

A series of hardware-inspired, multiplication-less networks-ShiftAddNet, ShiftAddNAS, ShiftAddViT, and ShiftAddLLM-that reparameterize CNNs, ViTs, and LLMs with bitwise shifts and adds for large energy and latency savings.

EyeCoD pairs lensless FlatCams with a predict-then-focus algorithm and a dedicated accelerator, achieving 10.95x, 3.21x, and 12.85x speedups over CPUs, GPUs, and a prior-art eye tracking processor.

Summary of efficient DNN training methods including E²Train, EB Train, FracTrain, and ShiftAddNet. Achieving over 80% training energy cost savings through data-level, model-level, and algorithm-level optimizations.

Recent works show that DNN training undergoes different stages, each stage shows different effects given a hyper-parameter setting. Analysis from optimization, generalization, and frequency domain perspectives.