To all women in this channel — all equal possibilities to pursue your career in computer science and become super cool professionals💪

GPT-4 is here

🥁

https://openai.com/research/gpt-4

To get access to API, you can sign up to the waiting list.

//no model architecture or implementation details 👍

Explainability for NLP

With the raise of LLMs from ClosedAI, the research in explainability for NLP is important as never before. Still, a lot of work should be done in the field. However, you already can experiment and try explain your fine-tuned LLMs on a specific task. For now, the majority of methods are explored for texts classification tasks and are adjusted from tabular data.

How it can be done?

1. Baseline approach: Leave-one-out explanations. For instance, you have a regression layer as one of the last layers in your model. You can check the tokens with major weights. Then, exclude them from the text and check if the model's answer has changed. If the tokens were indeed important, the answer should change dramatically as the model cannot orient on this words to make a correct decision.

2. Local Surrogate (LIME). Modification of the previous idea. Now, you delete each word from the sentence and check the results. The "importance" of the word will be estimated based on how the model's answer differ each time.

3. SHAP (SHapley Additive exPlanations). It is based on a game theory with the main idea to tell us how to fairly distribute the “payout” (= the prediction) among the features. So, one more modification of previous approaches with estimation of a score with three parameters — local accuracy, missingness, and consistency.

More details about how explainability can be used for general ML you can read in the book "Interpretable Machine Learning". The TUM, where I am right now, already did an overview of explainability methods for NLP and you can check this paper.

If we have explained a model, what is next? How we can fix model's misbehavior with such explanations? The continuation of explainability story will be in further posts😉

ELLIS Summer-Autumn Schools

European Laboratory for Learning and Intelligent Systems (ELLIS) this summer holds a series of summers schools:
https://ellis.eu/events

I am personally interested in Summer School on Large-Scale AI for Research and Industry — how to train models and operate with data with distributed computations. In the era of LLM seems important to obtain such skills😉

Find your school of interest🤘

Interviews

With Ilya Sutskever (GPT-4 creator and creator of many others important milestones in AI and NLP research):
https://youtu.be/SjhIlw3Iffs

With Sam Altman (OpenAI CEO):
https://youtu.be/L_Guz73e6fw

Fall is here and it's time to cozy up in our knitwear! Our sweaters are made with the softest yarns, ensuring you'll stay warm and comfortable all season long. From classic cable-knits to trendy oversized cardigans, we have the perfect sweater to match your style. Plus, our prices are affordable, so you don't have to break the bank to stay cozy. Shop now and embrace the chill in style. #CozySweaters #FallFashion #Knitwear #StayWarm #AffordableFashion
— ChatGPT

Img: Microsoft Designer

Prompts by a human (for now)

Microsoft Designer

I got access to Microsoft Designer and it is super interesting thing. You can generate design for posters, presentations, instagram posts, postcards, websites, invitations...

Now the Viber and Whatsapp postcards will know no limit.

Do you want to try to promote some your product?😉

11 PhD Positions in the MSCA Doctoral Network HYBRIDS

If you are thinking about doing PhD in NLP, check out this possibility!

All positions connected with the fight of fake news and toxic speech. The directions are super interesting, if I was not already a postdoc, I would have applied by myself😉

There is still a month to apply: the deadline is April, 26th.

https://hybridsproject.eu/jobs/

The recommendation from @bbkjunior. Subscribe to his channel @butterflai_effect🤗

🔥Free EACL 2023 for Ukrainian Students🔥

If you are Ukrainian students, you can apply or free EACL 2023 registration (both online and offline, but be aware of deadlines):
*online attendance — available for all Ukrainian students who apply through this form by April 16, 2023
*on-site attendance — available for a very limited number of Ukrainian students who apply through this form by April 7, 2023

Who is eligible to apply:
*students, including PhD students, currently studying at a Ukrainian academic institution
*students, including PhD students, who studied at a Ukrainian academic institution until February 24, 2022, but are currently studying abroad

https://forms.gle/WtMuxmNGoGnzvLRM7

📣Urgent news 📣

We need to shut down all AI

We need to turn off all GPU clusters

https://time.com/6266923/ai-eliezer-yudkowsky-open-letter-not-enough/

Guys, really, who answered

"My collegue was fired because of CharGPT" or
"Now I can do all my tasks with CharGPT"

Can you, please, share your stories? 🙂
Now, it is very intriguing!

A Survey of Large Language Models

* General overview;
* Listing by the number of parameters;
* Commonly used corpora for training;
* How pre-training can be done;
* Typical architecture types;
* How to fine-tune;
* How to prompt;
* Task possible to solve;
* Evaluation setups;

A very comprehensive survey:
https://arxiv.org/abs/2303.18223

MLSS 2023

1 day till application is closed to the Machine Learning Summer School with application in Science!
https://mlss2023.mlinpl.org/

I personaly took part in MLSS 2020, even if it was virtual, I got so many insights. This year is in Krakow! Get a chance to listen to a lectures from world-famous speakers😉