Stellar No BS Articles ConvMixer: Patches Are All You Need? | Spark in me

Stellar No BS Articles

ConvMixer: Patches Are All You Need?

- An extremely simple model (30 lines of code in a readable format, <10 lines in non-readable format) - patch layer + some wide conv layers
- Claims competitive quality for its simplicity
- No real huge resources poured in its design, unlike effnets / regnets / nasnets etc

- https://github.com/locuslab/convmixer
- https://arxiv.org/pdf/2201.09792v1.pdf

Looks like a resurgence of plain and working ideas. ConvNext, RepVGG and now this.

#no_bs