🏅 Top traders

Is anyone looking for it? This doesn't seem that hard (e.g., compare to looking up the capital of Italy), but it seems unlikely to be a priority for circuit searchers in 2023.

@JacyAnthis yes, @DanValentine mentioned he was looking for it

Why do you need a transformer for this?

@AnishaZaveri what do you mean? Gpt-4 has good indentation when it outputs python code, doesn't it? Where is "knowledge" inside the models?

@firstuserhere Sorry got confused. I thought it meant will someone design a transformer model to predict indentation in Python code

@AnishaZaveri no worries. But actually that could be a good experiment too. Instead of next token prediction, try to train it on next indentation prediction. Try to see what separates normal English text spaces and indentation in code. What neurons fire specifically for code, trying to identify that circuit, see if it happens similarly in a NLP transformer