????è¿???penAI???¨é???模å???å¸?å¤?模æ??大è?è¨?模å??GPT-4 ï¼?该模?????¨å??GPT-3.5/ChatGPT?¸å????????·¯çº¿ï?ä½?å¸þ=?¥ä??´å¥½???????§ã????ä½??§ã???¨ç???½å????å®??¨æ?§ç?ï¼????¶è?ç»?è¿?ç¨?ä¸????¨å??¶è?级è?ç®??ºè?è¡?ç®????¿è½½ï¼?并å???äº?大è?è¨?模å??scaling law?ºç???论ï?å®??°è?ç»?èµ?æº????§ã????ä»??¤æ???GPT-4????¥½????ï¼??????¨å?¨å?¨ç??AIé¢???????????ç»???LLMï¼?大è?è¨?模å??ï¼?模å???¶æ??ï¼?并é??è¿??´å??ç¾?å­?å·¥ç???å·§ç??ç»???ä¸???????AI产ä???å±?ï¼?å¸þ=?¥æ?´å?åº??¨å?ºæ???½å?°ç?????¶ï?äºþ@¸®?©äººç±»ä????¼è????¨äººå·¥æ?ºè??GI????ä»???ç»???å¥?penAI???¨ç??AIé¢?????产ä???èµ??ºä?ï¼?并建è®???ç»????þA??????ç®???设æ?½ã??模å???¶æ??&å·¥ç?å®?è·µã??åº??¨å?ºæ????¸å???????

???????¥å??ç¼?èµ·ï?OpenAIæ­£å???å¸?GPT-4??

??????äº??¶é??023å¹???14?¥æ??ï¼?OpenAI??å¸?äº?æ­£å???????GPT-4ï¼???代ä?æ­¤å??ChatGPT使ç?¨ç??GPT-3.5?????并å?å§?为ä?è´¹ç??Plus?¨æ?·æ??ä¾????¡ã??OpenAI?¨å?ç½?表示ï¼?GPT-4?½ç?¶å?¨å¤§å¤??°ç?°å??ºæ??¸­???½å??ä¸?å¦?人类ï¼?ä½??¨ä?äº?ä¸?ä¸??????å­þ=???ºå??ä¸?表ç?°å·²ç»???人类??å¹³ã??????¥å??å°??ºä?å¯?PT-4åº?å±??????»è???å®??°å???½è?ç»????????ºç?ä¸?ï¼??¢è?GPT-4对å?¨ç??AI产ä?å¸þ=?¥ç?????½æ????·¯å¾?å½±å??ï¼?以å??产ä?å±??¢ç?????????ºé????

??????GPT-4ï¼?å®??¨é???模å???å¸?ï¼?????ä¸???è¿?»£è°??´å?????å¤?模æ??大è?è¨?模å????

???????OpenAI?¨å??PT-4??å½¢å?ä¸?以å?模å??????å¸??½æ????ä¸???ï¼?OpenAI?¢æ²¡???????å¸?GPT-4???¸å?³è???ï¼?ä¹?没æ????ä¾?è¯þ>???æ¡??¶è???ï¼?ä»?ä»???ä¾?äº?ä¸?ä»?8页ç????????æ¡£ã????è¿?è¿?ä¸??¹å?ï¼?OpenAI?»æ??????????´è?????????´æ?¥é??å¾?ï¼?模å??大å????°æ??????建ã??è®???¹æ?ç­?ï¼?ï¼?å°??????è·?º¿?????°å?ï¼?è¿?ä¹?ç¬þ@????ä»????对è?ä¸????¥å??å±????¤æ???é¢?????头é?¨å???¸ï?OpenAI??Googleï¼?å°????????è·?º¿ï¼??¿å???¶ä????¸å??°å?¶æ¨¡??ï¼??½å??ä¸??°ä¸¤ä¸?º«ä½??????¸ï?Meta??Amazon??NVIDIAç­?ï¼????½ä????©å?æº?è·?º¿ï¼?å¯?å¸?????è¿?社å?ºç??????????è¿?»£??

?????¹æ??penAI??å¸???è¿?份æ?????¥å??ï¼?GPT-4??è®??以å??è¿?»£?????¶é?¿è¾¾6ä¸???以ä?ï¼????????å¸???ChatGPT??两å??以ä?ï¼??¨æ????·¯å¾?ä¸?沿ç?¨ä?????å½???Transformer模å????ä¸?人类??é¦?强å??å­þ????模å???½å???¹é?¢æ??大ç???????¨ä?å¼??¥ä?å¤?模æ????å¤????½å??ï¼??¤ä?æ­¤å??ChatGPTå°±æ????????å­?å¤?ï¼?GPT-4è¿???»¥?¥å???¾ç??è¾??¥ï?ä¸?è¿????¶è?没æ??å¼??¾ç??¨æ?·ä½¿?¨ã??æ­¤å?ï¼?模å???¨é?¢å?å¤???ä»»å?¡ç???????§ä?è¾??ºç??å®??¨æ?§ä??????¾è??????????

??????模å??è®???³é???¹ï????¨å??¶å??è¶?级è?ç®??ºï?å®???äº?大è?è¨?模å??scaling law?ºç???论ã??

????å°½ç?OpenAI没æ?????模å???????·ä?è®??ç»???ï¼?ä½?ä»??¶å?¨æ??????档中??表述?ºå??ï¼???ä»??¾å?°ä?两ç?¹å???½ä?å½±å???´ä?产ä????³é???¹ï?

????1ï¼?OpenAI?¨å?»å¹´å¼?å§?å°±ä?å¾?½¯??ä½????°æ??建ä??°ç?¨ä?大è?è¨?模å??è®????è¶?级è?ç®??ºï??????GPT-4??è®??以å??è¿?»£????åº?该æ????¨é??è¿?è¿??°è?ç®??ºæ??å®????????¹æ??loomberg???¸å?³æ?¥é??ï¼?OpenAIä¸?å¾?½¯????»º??è¿??°è?ç®??ºæ?»å?±è??èµ??°äº¿ç¾???ï¼?使ç?¨ä?è¿?ä¸?å¼??±ä?è¾?100?¾å?¡ï?è¿?ä¹?ä¸???ä»?????¥å??ä¸??è®??大è?è¨?模å??????è¦????¾å?¡ä???计ç??¸ä??´ã??ä»?OpenAI?¨æ??????档中??è¿°ç??ç»?????ï¼?è®??+è¿?»£?»å?±è????ä¸???ï¼?ï¼?GPT-4??è®??è¿?ç¨?è¿????æ­¤å????é¢???ï¼?ä»?ä¹?????论æ???ºå??ï¼?å¦?æ­¤ä?????模å??è¿?»£?¨å????对å?¶å°±è¦???è´¹æ?°æ???¶é?´ï?ï¼?è¿?ä¹?表æ??äº???建ä??¨è?级è?ç®??ºç??å¿?è¦??§ã????ä»??为ï??¨æ???¥æ?°æ???¶é?´æ??ä»??ä¼????°æ?´å?AI大å????ä»?penAI????æ³?ï¼?å°?å®??¶å????è¶?级è?ç®??ºæ??ä¸??¥ç???

????2ï¼?Scaling Law??penAI?¢é????020å¹´å??表ç??论æ??ï¼?主è?对模???½å??ä¸?模å??大å???è®???¶é?¿é?´ç???³ç³»??äº??¨ç?ï¼?ä¹???为ä?大è?è¨?模å????究ç????è¦???论ã?????¨æ???OpenAI???????¥å??ä¸????ä»????°å?scaling law??äº?è¿?ä¸?æ­¥ç??å®?????OpenAI表示?¨å???GPT-4??è¿?ç¨?ä¸??ä¸?æ­¥å???äº?Scaling Lawï¼?对æ?????æ³?解é????æ¶??°è?½å??ï¼?å½?模å??ä½?ç§?¤§å°?çª??´å?°æ??ä¸??¶æ??¶ä?çª??¶å?ºç?°æ??ç§??°è?½å??ï¼???»¥?´å¥½??é¢?æµ???Scaling Law??å®???ä¹????³ç???¨æ¨¡??è®??èµ?æº??????¥å?ä¼??´å?????§ï?AI????å°?ä¸?????è¦?为ä?æ¶??°è?½å??ä¸??³æ?©å¤§???°ï?è¿?å°?è¿?ä¸?æ­¥é??ä½?AIè®???¶æ?????????

??????åº??¨å?ºæ???å¤?模æ???½å??????å¤?é¢??????°ã??

????GPT-4?¸è?äº?ChatGPT???´è????¹å???¨ä????¥ä??????¾ç??è¾??¥ç??å¤?模æ?????½å????å°½ç?OpenAI表示????å¤?模æ???½å???????¹è??¨ä??¾ç??è½???å­?ï¼?对ä??³é???è§?é¢????¾ç??ç¼?è¾?ç­?è¿?ä¸?????ï¼?ä½?è¿?ä¹?ç»?äº?å¸??ºè¶³å¤????³è±¡ç©ºé?´ã??

????1ï¼? ??ç´¢é???ï¼?ç»????¾ç??è¾??¥ç??å¤?模æ??å°??´å¥½??为ç????ä¼?ç»???ç´¢å???+大è?è¨?模å??è¾??©ç??模å?è¿?è¡????¡ã??

????2ï¼??ºè?½å???ï¼??¾ç??ä¸???å­?ç»???è¾??¥ç??模å??´å??è´´å??????ToC?ºè?½å????????°ç??ä¸?äº????¹ã??

????3ï¼?ä¸??模å?????¸å¾®è°?模å??åº??¨å?°å?·ä?ç»???é¢???ï¼?GPT-4è¢???述为ä¸?ä¸????¨ç??大è?è¨?模å??ï¼?ä»?OpenAI????æ¡£ç??ä»?ä»??没æ???´è¶£å¯¹å?·ä?ç»???é¢???è¿?è¡?å¾??以æ??´å¥½????ï¼??£ä?è¿?ä¸??¨æ???¥å°±???¶ä?交å?°ä¸­å°?人工?ºè?½å??????ä¸????PT-4???ºç?ä¸???对ç???è¡?ä¸?è¿?è¡?å¾???¥è?·å??´å¥½??????

??????é£??©å??ç´?ï¼?

????AI?¸å???????å±?ä¸???é¢???é£??©ï?ç§???é¢????¿ç???管æ??ç»??¶ç´§é£??©ï??¨ç??å®?è§?ç»?æµ?å¤???ä¸???é¢???é£??©ï?å®?è§?ç»?æµ?æ³¢å?¨å??´æ?ç¾?ä¼?ä¸?IT???ºä???é¢???é£??©ï??¨ç??äº?计ç?å¸??ºå??å±?ä¸???é¢???é£??©ï?ä¼?ä¸??°æ????²ã??ä¿¡æ????¨é??©ï?è¡?ä¸?ç«?äº???ç»????§é??©ç???

????????èµ?ç­??¥ï?

????GPT-4 ???¨ä? GPT-3.5/ChatGPT ?¸å????????·¯çº¿ï?ä½?å¸þ=?¥ä??´å¥½???????§ã????ä½??§ã???¨ç???½å??ï¼?以å??å¤?模æ???½å??ç­???GPT-4????¥½????ï¼??????¨å??Ié¢???????????ç»???LLM模å???¶æ??ï¼?并é??è¿??´å??ç¾?å­?å·¥ç???å·§ç??ç»???ä¸???????AI产ä???å±?ï¼?å¸??©äººç±»ä????¼è????¨äººå·¥æ?ºè??GI????ä»???ç»???å¥?penAI??AIé¢?????产ä???èµ??ºä?ï¼?并建è®???ç»????þA??????ç®???设æ?½ã??模å???¶æ??&å·¥ç?å®?è·µã??åº??¨å?ºæ????¸å???????