{"id":9671,"date":"2023-04-14T17:02:50","date_gmt":"2023-04-14T15:02:50","guid":{"rendered":"https:\/\/scienceetonnante.com\/?p=9671"},"modified":"2023-04-16T21:04:50","modified_gmt":"2023-04-16T19:04:50","slug":"comment-fonctionne-chatgpt","status":"publish","type":"post","link":"https:\/\/scienceetonnante.com\/blog\/2023\/04\/14\/comment-fonctionne-chatgpt\/","title":{"rendered":"Comment fonctionne ChatGPT ?"},"content":{"rendered":"<p>Je ne suis ni le premier, ni le dernier&#8230;parlons de ChatGPT !<\/p>\n<p><iframe title=\"Ce qui se cache derri\u00e8re le fonctionnement de ChatGPT\" width=\"770\" height=\"433\" data-src=\"https:\/\/www.youtube.com\/embed\/7ell8KEbhJo?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" allowfullscreen src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" class=\"lazyload\" data-load-mode=\"1\"><\/iframe><\/p>\n<p>&nbsp;<\/p>\n<p>Le serveur Discord de Science \u00e9tonnante \u27a1\ufe0f <span class=\"yt-core-attributed-string--link-inherit-color\"><a class=\"yt-core-attributed-string__link yt-core-attributed-string__link--display-type yt-core-attributed-string__link--call-to-action-color\" tabindex=\"0\" href=\"https:\/\/www.youtube.com\/redirect?event=video_description&amp;redir_token=QUFFLUhqa3BRa19fSi00Qlh3RWxnczQ4QWJBSjRJcEFiUXxBQ3Jtc0tucGxNQWhhaEZpeFp5aGxUV19fV3VjLWRWaE5JRi02ZWpJenZRc2laR3FNUDZzN3laS0M1al9ZaEhiTU9IOHVhWDZ2RDY0UlFQLWpoRHRRWU0xWlp2SGtEU29BTGFyVmljZmktb2x2UWVkUm5oYUlSOA&amp;q=https%3A%2F%2Fdiscord.gg%2FGPamYjVYxA&amp;v=7ell8KEbhJo\" target=\"_blank\" rel=\"nofollow noopener\">https:\/\/discord.gg\/GPamYjVYxA<\/a><\/span><\/p>\n<p>J&rsquo;ai longuement h\u00e9sit\u00e9 pour cette vid\u00e9o a faire un long passage plus technique sur les transformers, et puis je me suis dit que \u00e7a ferait trop long et un peu trop grand \u00e9cart entre les principes g\u00e9n\u00e9raux et les d\u00e9tails techniques.<\/p>\n<p>Mais si le sujet vous int\u00e9resse, je vous recommande <a href=\"https:\/\/www.youtube.com\/watch?v=kCc8FmEb1nY\" target=\"_blank\" rel=\"noopener\">les vid\u00e9os d&rsquo;Andrej Karpathy<\/a>, un des chercheurs les plus en pointe du domaine, et qui a cr\u00e9\u00e9 une version \u00ab\u00a0p\u00e9dagogique\u00a0\u00bb qu&rsquo;il a appel\u00e9 NanoGPT. En suivant <a href=\"https:\/\/github.com\/karpathy\/nanoGPT\" target=\"_blank\" rel=\"noopener\">son code<\/a> on comprend bien ce qu&rsquo;il se passe.<\/p>\n<p>J&rsquo;h\u00e9site toujours \u00e0 faire une vid\u00e9o d\u00e9di\u00e9e aux transformers&#8230;<\/p>\n<p>Sur la question de l&rsquo;apprentissage par renforcement avec feedback humain, <a href=\"https:\/\/time.com\/6247678\/openai-chatgpt-kenya-workers\/\" target=\"_blank\" rel=\"noopener\">le TIME magazine<\/a> a rapport\u00e9 qu&rsquo;une partie du \u00ab\u00a0feedback\u00a0\u00bb avait \u00e9t\u00e9 fourni par des travailleurs au Kenya, et leurs t\u00e9moignages font peur \u00e0 voir. En effet certains ont d\u00fb se coltiner des messages toxiques ou carr\u00e9ment horribles dans le but de les \u00ab\u00a0\u00e9valuer\u00a0\u00bb, et ce toute la journ\u00e9e. OpenAI a d\u00e9clar\u00e9 avoir arr\u00eat\u00e9 ces pratiques.<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Je ne suis ni le premier, ni le dernier&#8230;parlons de ChatGPT ! &nbsp; Le serveur Discord de Science \u00e9tonnante \u27a1\ufe0f https:\/\/discord.gg\/GPamYjVYxA J&rsquo;ai longuement h\u00e9sit\u00e9 pour cette vid\u00e9o a faire un long passage plus technique sur les transformers, et puis je me suis dit que \u00e7a ferait trop long et un peu trop grand \u00e9cart entre<\/p>\n","protected":false},"author":1,"featured_media":9672,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[45],"tags":[113],"class_list":{"0":"post-9671","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-informatique","8":"tag-intelligence-artificielle"},"jetpack_featured_media_url":"https:\/\/scienceetonnante.com\/blog\/wp-content\/uploads\/2023\/04\/blog.png","jetpack_sharing_enabled":true,"post_mailing_queue_ids":[],"_links":{"self":[{"href":"https:\/\/scienceetonnante.com\/blog\/wp-json\/wp\/v2\/posts\/9671","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/scienceetonnante.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/scienceetonnante.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/scienceetonnante.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/scienceetonnante.com\/blog\/wp-json\/wp\/v2\/comments?post=9671"}],"version-history":[{"count":3,"href":"https:\/\/scienceetonnante.com\/blog\/wp-json\/wp\/v2\/posts\/9671\/revisions"}],"predecessor-version":[{"id":9675,"href":"https:\/\/scienceetonnante.com\/blog\/wp-json\/wp\/v2\/posts\/9671\/revisions\/9675"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/scienceetonnante.com\/blog\/wp-json\/wp\/v2\/media\/9672"}],"wp:attachment":[{"href":"https:\/\/scienceetonnante.com\/blog\/wp-json\/wp\/v2\/media?parent=9671"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/scienceetonnante.com\/blog\/wp-json\/wp\/v2\/categories?post=9671"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/scienceetonnante.com\/blog\/wp-json\/wp\/v2\/tags?post=9671"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}