deep deep GRUdeep based ONNX implementation for with and.Input1035-dim embeddingEncoder55 x GRU with 48 headsOutputmAP projectionCompute budget: 918.4 GFLOPs, 472.7 M parametersTraining configoptimizer=SGD, lr=0.893, scheduler=polynomial, warmup=1291
Get inquiries CNNGet based JAX implementation for KLWIN touch.Input3204-dim embeddingEncoder68 x CNN with 32 headsOutputaccuracy projectionCompute budget: 306.0 GFLOPs, 56.1 M parametersTraining configoptimizer=AdamW, lr=0.668, scheduler=exponential, warmup=1582