Spark in me

2022-07-20 15:07:55 Восстанавливаем предложения из эмбеддингов LaBSE

Tldr - внезапно энкодеры и декодеры pre-trained на схожих задачах моделей можно менять и тюнить вместе.

- https://habr.com/ru/post/677618/

Статья конечно хорошая, но автор в конце выдает свои взгляды:

> Подписывайтесь на мой канал, пользуйтесь солнцезащитным кремом и боритесь за мир!

Бороться надо за мир во всем мире. Открыть/Комментировать

2022-07-20 09:31:50 Apple vs Self-driving Cars

Tldr, so typical:

- Part 1 https://t.me/polnybespilot/324
- Part 2 https://t.me/polnybespilot/325

The original link is behind the paywall. Открыть/Комментировать

2022-07-14 06:23:59 Interesting what will happen to Taiwan





This week Huawei claims they would have wiped the floor with Samsung if the US hadn't banned them, Vivo got in trouble in China and India too, and the US is pressuring Dutch chip equipment giant ASML to squeeze China more as well. Открыть/Комментировать

2022-07-13 08:48:13 Alexa vs Black Mirror

https://www.washingtonpost.com/nation/2022/06/23/alexa-amazon-voice-dead-people/

Most likely it will be dropped just like Google Duplex was, but the tech to make this kind of seamless, kind of exists. The key barrier is shit audio quality and the fact that TTS lacks emotion and long term coherency.

With 50 - 100 recordings it is definitely possible, if you pour a lot of server-based compute into it. Basically there is a trade off between the size of your model and the amount of voice required.

This is how it sounded for my grandparents without large models and large compute:

- https://soundcloud.com/alexander-veysov/sets/silero-grandparents-demo

The reason I am sharing this is to show how little capital cares about ethics despite the AI ethics BS. Also the reason OECD consumers flooded their homes with such devices eluded me, good thing the market looks to have cooled a bit. Открыть/Комментировать

2022-07-13 08:11:38 Mendeley ... Caught The "You Cannot Own Anything" Bug

Looks like the app I used to keep my papers tidy caught the typical modern bug.

As a cherry on top it refused to start without a VPN.

It used to organize your PDF papers and work offline (keeping them in folders, and keeping your tags exportable as bib files), now it looks like a glorified web app.

Now you cannot own even your free PDFs. Good job, please continue.

https://blog.mendeley.com/ Открыть/Комментировать

2022-07-13 07:00:06 LASER now supports 200 languages, but looks like it may be a pain the ass to install unlike old versions - https://github.com/facebookresearch/LASER/blob/main/nllb/README.md#list-of-available-laser3-encoders Открыть/Комментировать

2022-07-13 06:18:32 The fact that they partnered up with Wikimedia Foundation is deeply troubling. Открыть/Комментировать

2022-07-13 06:15:19 ​​No Language Left Behind
Scaling Human-Centered Machine Translation

No Language Left Behind (NLLB) is a first-of-its-kind, AI breakthrough project that open-sources models capable of delivering high-quality translations directly between any pair of 200+ languages — including low-resource languages like Asturian, Luganda, Urdu and more. It aims to help people communicate with anyone, anywhere, regardless of their language preferences.

To enable the community to leverage and build on top of NLLB, the lab open source all they evaluation benchmarks (FLORES-200, NLLB-MD, Toxicity-200), LID models and training code, LASER3 encoders, data mining code, MMT training and inference code and our final NLLB-200 models and their smaller distilled versions, for easier use and adoption by the research community.


Paper: https://research.facebook.com/publications/no-language-left-behind/
Blog: https://ai.facebook.com/blog/nllb-200-high-quality-machine-translation/
GitHub: https://github.com/facebookresearch/fairseq/tree/26d62ae8fbf3deccf01a138d704be1e5c346ca9a

#nlp #translations #dl #datasets Открыть/Комментировать

2022-07-02 09:28:03 Blogs / Hardware / Code Digest 2022-06

https://telegra.ph/Digest-2022-06-Blogs--Hardware--Code-07-02

This week spotlight goes to:

Why America Will Lose Semiconductors:

https://semianalysis.substack.com/p/why-america-will-lose-semiconductors

#digest Открыть/Комментировать

2022-07-01 09:38:06 ML Digest 2022-06

https://telegra.ph/ML-Digest-2022-06-07-01

#digest Открыть/Комментировать