... it's a bad day at the office if you work at a place like Tableau, MathWorks or Wolfram. CI isn't yet a replacement for any of those companies' products, but who's going to sign any long-term contracts with them from this point on? Not me. It's hard to see what this model can't do, given sufficient development.
Calling this thing "Code Interpreter" is an interesting decision on OpenAI's part. It looks more like the Babel Fish of data science. Utterly amazing.
Yes I am a PM, product manager. I've been learning python. My dream is, I can go from client engagement, data digestion to insights and analytics delivered as a one man team.
What used to take a team a week, I want to be able to do myself in one to two days.
The impression I got from the videos is that CI is already capable of outperforming Alpha, at least in some respects. There's a Wolfram Alpha plugin, but CI seemed to return better results.
As I understand it, Mathematica is more or less a client-side Alpha at this point, and vice versa.
>Mathematica is more or less a client-side Alpha at this point
They're not really comparable. Wolfram Alpha exposes a small fraction of the symbolic/numeric algorithms Mathematica has, and the reasons why someone would choose Mathematica over e.g. SymPy+NumPy won't really change with LLMs in the mix. If anything, in the age of LLM generated code, Mathematica might even have an advantage over the others because of how concise and uniform the language is, and Wolfram has already shown interest in integrating with chatGPT.
I don't see Mathworks really being affected either, since as I understand most of their money is made via the proprietary toolkits (otherwise someone could just use Octave). Tableau is probably toast though.
Here are the standout features of the code interpreter plugin, based on my experience using it ~10 times:
1. Handle Large Files with Ease: Unlike the model's limited context window, this plugin accepts significantly larger files. It stores the file and executes Python code on it whenever necessary. It's worth noting that the code can utilize a specific set of libraries, including PyPDF2, but not AI libraries.
2. Generate and Execute Code: This plugin goes beyond code generation. It also executes the generated code and provides you with the output.
In a nutshell, the code interpreter plugin saves you from the hassle of:
- Describing the input file format to ChatGPT, as it automatically adapts the code accordingly.
- Manually copying code from ChatGPT to a Jupyter notebook to view the output.
The point is this kind of 'on-the-fly' software or ui dispenses with the need of countless small web apps and parts of larger software.
"Display my calendar for the next 3 weeks, in a vertical column per day, divided into hours, with an expanded fisheye view of morning work hours and highlight any out-of-office meetings. Make meetings clickable, and when clicked, open a page including more details of the meeting and it's participants, and links to their facebook pages. Save the program as part of my dashboard"
There are rumors that the 'code interpreter' plugin in particular is different, like it uses more advanced training possibly even a more advanced pre-trained model and that it's better understood as like GPT-4.5. I personally don't have access so I can't even give personal anecdotal evidence though.
When I've used the code interpreter in similar cases, it generates plots using Python code that it provides. So typical not hallucinating, and it shows its work (the Python) which lets me verify.
Even the term hallucinate gives them too much credit. It's more accurate to say they just make stuff up that sometimes happens to be accurate or useful.
If you click the "..." icon next to your name at the lower-left corner of the window, you can enter a 'Settings' menu that lets you enable plugins via 'Beta features'. Nothing seems to change when I do that, and I don't see any other buttons to push to activate Code Interpreter or any other plugin features.
https://www.youtube.com/watch?v=O8GUH0_htRM and the followup video here: https://www.youtube.com/watch?v=_njf22xx8BQ
... it's a bad day at the office if you work at a place like Tableau, MathWorks or Wolfram. CI isn't yet a replacement for any of those companies' products, but who's going to sign any long-term contracts with them from this point on? Not me. It's hard to see what this model can't do, given sufficient development.
Calling this thing "Code Interpreter" is an interesting decision on OpenAI's part. It looks more like the Babel Fish of data science. Utterly amazing.