{"id":16743,"date":"2023-02-13T09:54:58","date_gmt":"2023-02-13T08:54:58","guid":{"rendered":"https:\/\/www.hackingchinese.com\/?p=16743"},"modified":"2023-02-13T10:13:32","modified_gmt":"2023-02-13T09:13:32","slug":"can-chatgpt-pass-the-hsk","status":"publish","type":"post","link":"https:\/\/www.hackingchinese.com\/can-chatgpt-pass-the-hsk\/","title":{"rendered":"Can ChatGPT pass the HSK?"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-16768 size-large\" src=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/chatgpt-hsk-banner-1024x205.jpeg\" alt=\"\" width=\"1024\" height=\"205\" srcset=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/chatgpt-hsk-banner-1024x205.jpeg 1024w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/chatgpt-hsk-banner-300x60.jpeg 300w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/chatgpt-hsk-banner-768x154.jpeg 768w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/chatgpt-hsk-banner-1536x307.jpeg 1536w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/chatgpt-hsk-banner-2048x410.jpeg 2048w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/>ChatGPT is a chat bot developed by OpenAI and was launched in late 2022. It\u2019s been all over the press as the fastest growing web platform of all time, so most of you have probably heard of it. Reports of it being able to pass university exams in a range of subjects have been all over both traditional and social media, which makes me wonder: Can ChatGPT pass the HSK?<\/p>\n<p>I will write more about using ChatGPT for learning and teaching Chinese in future articles, so if you have ideas for how it can or cannot be used, please leave a comment below or send me an email! In this article, we will focus on the HSK specifically.<\/p>\n<p><em>Tune in to <a href=\"https:\/\/www.hackingchinese.com\/podcast\/\">the Hacking Chinese Podcast<\/a> to listen to the related episode:<\/em><br \/>\n<iframe loading=\"lazy\" src=\"https:\/\/anchor.fm\/hackingchinese\/embed\/episodes\/132---Can-ChatGPT-pass-the-HSK-e1urtja\" width=\"400px\" height=\"102px\" frameborder=\"0\" scrolling=\"no\"><\/iframe><br \/>\n<em>Available on <a href=\"https:\/\/podcasts.apple.com\/us\/podcast\/hacking-chinese-podcast\/id1536284827\">Apple Podcasts<\/a>, <a href=\"https:\/\/www.google.com\/podcasts?feed=aHR0cHM6Ly9hbmNob3IuZm0vcy8zODhlYjllOC9wb2RjYXN0L3Jzcw==\">Google Podcasts<\/a>, <a href=\"https:\/\/overcast.fm\/itunes1536284827\/hacking-chinese-podcast\">Overcast<\/a>, <a href=\"https:\/\/open.spotify.com\/show\/5iCRv1jg3j3yJZGJlYVYaO\">Spotify<\/a>, <a href=\"https:\/\/www.youtube.com\/c\/HackingChinese\">YouTube<\/a> and many other platforms!<\/em><\/p>\n<h3>Can ChatGPT pass the HSK?<\/h3>\n<p><a href=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/robot-reading.jpeg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignright wp-image-16767 size-medium\" src=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/robot-reading-300x300.jpeg\" alt=\"Robot reading. Created with Stable Diffusion and some GIMP editing for the book cover.\" width=\"300\" height=\"300\" srcset=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/robot-reading-300x300.jpeg 300w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/robot-reading-150x150.jpeg 150w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/robot-reading.jpeg 768w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a>I considered letting ChatGPT write the article for me, but letting it write articles about itself\u00a0 has been done by so many others that it\u2019s getting boring. Also, ChatGPT does much better with shorter texts and clear prompts. Let\u2019s hit two birds with one stone and use ChatGPT to introduce itself, the HSK and the task at hand!<\/p>\n<p><em><strong>Note:<\/strong> I have introduced ChatGPT to many people recently, mostly in a professional context, and I have noticed that simply telling people about it doesn\u2019t work, because they often dismiss it as just another mediocre chat bot. It is not. While I can show you my interactions with ChatGPT, I strongly encourage you to <a href=\"https:\/\/chat.openai.com\/\">try it out yourself<\/a> if you haven\u2019t!<\/em><\/p>\n<p>Here&#8217;s what we will cover in this article:<\/p>\n<ol>\n<li><a href=\"#whatgpt\">Asking ChatGPT<\/a>\n<ul>\n<li><a href=\"#whatgpt\">What is ChatGPT?<\/a><\/li>\n<li><a href=\"#whathsk\">What is the HSK?<\/a><\/li>\n<li><a href=\"#passhsk\">Do you think you could pass the HSK?<\/a><\/li>\n<\/ul>\n<\/li>\n<li><a href=\"#canpass\">Can ChatGPT even take the HSK?<\/a><\/li>\n<li><a href=\"#lsrw\">Listening, speaking, reading and writing<\/a><\/li>\n<li><a href=\"#mock\">Using mock HSK exams to test ChatGPT&#8217;s reading ability<\/a><\/li>\n<li><a href=\"#hsk3\">ChatGPT vs. HSK 3<\/a>\n<ul>\n<li><a href=\"#hsk31\">Part 1<\/a><\/li>\n<li><a href=\"#hsk32\">Part 2<\/a><\/li>\n<li><a href=\"#hsk33\">Part 3<\/a><\/li>\n<li><a href=\"#copying\">But wait, isn&#8217;t it just copying the answers?<\/a><\/li>\n<li><a href=\"#hsk3results\">ChatGPT got 27\/30 on HSK 3<\/a><\/li>\n<\/ul>\n<\/li>\n<li><a href=\"#hsk45\">ChatGPT vs. HSK 4-5<\/a><\/li>\n<li><a href=\"#hsk6\">ChatGPT vs. HSK 6<\/a><\/li>\n<li><a href=\"#so\">So can ChatGPT pass the HSK?<\/a><\/li>\n<li><a href=\"#means\">What does this mean?<\/a><\/li>\n<li><a href=\"#learnteach\">How to use ChatGPT to learn and teach Chinese<\/a><\/li>\n<\/ol>\n<p><a name=\"whatgpt\"><\/a><\/p>\n<h3>ChatGPT: What is ChatGPT?<\/h3>\n<p><a href=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/gpt-intro.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone\" src=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/gpt-intro.png\" alt=\"Screenshot of a conversation between Olle and ChatGPT: Olle: What is ChatGPT? ChatGPT: ChatGPT is a conversational language model developed by OpenAI. It's based on the GPT-3 (Generative Pretrained Transformer 3) architecture, which is a state-of-the-art language model that has been trained on a massive corpus of text data from the internet. The goal of ChatGPT is to generate human-like text responses given a prompt, allowing it to participate in conversations and answer questions on a variety of topics. The model has been fine-tuned for various conversational tasks, including response generation, question answering, and dialogue generation. Olle: Write that in one sentence in plain language. ChatGPT: ChatGPT is a computer program created by OpenAI that can have written conversations with people by generating text based on the information it learned from the internet.\" width=\"1324\" height=\"920\" \/><\/a><br \/>\n<a name=\"whathsk\"><\/a><\/p>\n<h3>ChatGPT: What is the HSK?<\/h3>\n<p><a href=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/gpt-hsk.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-16747\" src=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/gpt-hsk.png\" alt=\"Screenshot of ChatGPT describing the HSK: Olle: Tell me about the HSK. ChatGPT: The HSK (H\u00e0ny\u01d4 Shu\u01d0p\u00edng K\u01ceosh\u00ec) is a standardized test that assesses the Chinese language proficiency of non-native speakers. It was created by the Chinese government and is used for various purposes, including for admission to Chinese universities, for visa and immigration purposes, and for job applications. The HSK test covers a wide range of language skills, including vocabulary, grammar, reading comprehension, and listening comprehension. The test is divided into six levels, with Level 1 being the most basic and Level 6 being the most advanced. Each level becomes increasingly difficult, testing more advanced grammar structures, vocabulary, and comprehension abilities. The HSK test is offered in various locations around the world and is taken by individuals who are learning Chinese as a second language, as well as by people who are living and working in Chinese-speaking countries. It is widely recognized as a measure of Chinese language proficiency and is considered to be an important tool for people who want to improve their Chinese language skills and demonstrate their proficiency to others.\" width=\"1325\" height=\"973\" srcset=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/gpt-hsk.png 1325w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/gpt-hsk-300x220.png 300w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/gpt-hsk-1024x752.png 1024w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/gpt-hsk-768x564.png 768w\" sizes=\"auto, (max-width: 1325px) 100vw, 1325px\" \/><\/a><br \/>\n<a name=\"passhsk\"><\/a><\/p>\n<h3>ChatGPT: Do you think you could pass the HSK?<\/h3>\n<p><a href=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/gpt-take-hsk.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-16745 size-full\" src=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/gpt-take-hsk.png\" alt=\"\" width=\"1329\" height=\"784\" srcset=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/gpt-take-hsk.png 1329w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/gpt-take-hsk-300x177.png 300w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/gpt-take-hsk-1024x604.png 1024w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/gpt-take-hsk-768x453.png 768w\" sizes=\"auto, (max-width: 1329px) 100vw, 1329px\" \/><\/a><\/p>\n<h3><a href=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/gpt-try.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-16746 size-full\" src=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/gpt-try.png\" alt=\"Screenshot of a conversation between Olle and ChatGPT: Olle: Let's try and see how well you do! ChatGPT: Certainly! I'll do my best to answer any questions you have in Chinese. Please keep in mind that my knowledge is limited to what I've been trained on and my responses might not always be perfect. However, I'll do my best to help with any questions or tasks you have in mind!\" width=\"1329\" height=\"390\" srcset=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/gpt-try.png 1329w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/gpt-try-300x88.png 300w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/gpt-try-1024x300.png 1024w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/gpt-try-768x225.png 768w\" sizes=\"auto, (max-width: 1329px) 100vw, 1329px\" \/><\/a><\/h3>\n<p><a name=\"canpass\"><\/a><\/p>\n<h3>Can ChatGPT even take the HSK?<\/h3>\n<p>We will see some more of ChatGPT&#8217;s capabilities later when we get to the actual exam, but let\u2019s discuss some practical issues first, some of which were mentioned above by ChatGPT itself.<\/p>\n<p>Obviously, ChatGPT can\u2019t take the HSK. You have to be a real person to sign up and you need to be smarter than ChatGPT to understand how the exam works. However, with some handholding, it\u2019s still possible to feed the exam questions to the bot to see how it would perform on various levels of the HSK.<\/p>\n<p>Unfortunately, the two lowest levels on the exam rely on images, which makes them impossible to use (ChatGPT has no image recognition capabilities). Starting from HSK 3, all reading comprehension questions are pure text, however, and any images do nothing more than provide hints to the general topic of the text. Hence, we&#8217;ll focus on HSK 3-6. <a href=\"https:\/\/www.hackingchinese.com\/the-new-hsk-3-0-what-you-need-to-know\/\">This will all be HSK 2.0 as HSK 3.0 has only started rolling out, and only with the most advanced levels.<\/a><\/p>\n<blockquote class=\"wp-embedded-content\" data-secret=\"yF77KrOIhZ\"><p><a href=\"https:\/\/www.hackingchinese.com\/the-new-hsk-3-0-what-you-need-to-know\/\">The new HSK 3.0: What you need to know<\/a><\/p><\/blockquote>\n<p><iframe loading=\"lazy\" class=\"wp-embedded-content\" sandbox=\"allow-scripts\" security=\"restricted\" style=\"position: absolute; clip: rect(1px, 1px, 1px, 1px);\" title=\"&#8220;The new HSK 3.0: What you need to know&#8221; &#8212; Hacking Chinese\" src=\"https:\/\/www.hackingchinese.com\/the-new-hsk-3-0-what-you-need-to-know\/embed\/#?secret=7KgKbtQNiB#?secret=yF77KrOIhZ\" data-secret=\"yF77KrOIhZ\" width=\"500\" height=\"282\" frameborder=\"0\" marginwidth=\"0\" marginheight=\"0\" scrolling=\"no\"><\/iframe><\/p>\n<p><a name=\"lsrw\"><\/a><\/p>\n<h3>Listening, speaking, reading and writing Chinese<\/h3>\n<p>To pass the exam, you also need to be able to listen, speak, read and write. For ChatGPT, listening, would the same as reading, plus an added speech-to-text layer. If it can pass reading questions, it should be able to deal with listening as well, provided that the transcribing goes well. The goal here is not to evaluate transcription software, so we&#8217;ll focus on reading.<\/p>\n<p>Speaking and writing are hard to test, because I&#8217;m not a trained HSK examiner and don&#8217;t know how the speaking and writing parts are graded. The listening and reading parts contain only multiple-choice questions, which makes it easy to check the right answer. If there&#8217;s enough interest, I could return to the topic of writing (and maybe speaking) in a follow-up article and evaluate it anyway.<br \/>\n<a name=\"mock\"><\/a><\/p>\n<h3>Using mock HSK exams to test ChatGPT&#8217;s reading ability<\/h3>\n<p><a href=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/download-10.jpeg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignright wp-image-16769 size-medium\" src=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/download-10-300x300.jpeg\" alt=\"\" width=\"300\" height=\"300\" srcset=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/download-10-300x300.jpeg 300w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/download-10-150x150.jpeg 150w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/download-10.jpeg 768w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a>Thus, we are left with reading comprehension. This doesn&#8217;t sound like much, but it is a substantial part of the exam, and don&#8217;t forget that we expect it to be able to do roughly as well on the listening part, given that speech-to-text is quite good these days.<\/p>\n<p>These combined make up 70 out of the 80 points on HSK 3, for example, so if ChatGPT does well enough, it might be able to pass even with 0 points on the writing part!<\/p>\n<p>To test if ChatGPT can pass the HSK, I used the official mock exams from <a href=\"https:\/\/www.hskmock.com\/home\/index\">HSK Mock<\/a>. If you want to check them yourself or see exactly which questions ChatGPT got wrong, just download the appropriate mock exam from the website. Here are direct links to the PDF documents:<\/p>\n<ol>\n<li><a href=\"https:\/\/mock-public-staging.wohui.co\/level-file\/HSK3\/HSK3%20%E6%A0%B7%E5%8D%B7.pdf\">HSK 3<\/a><\/li>\n<li><a href=\"https:\/\/mock-public-staging.wohui.co\/level-file\/HSK4\/HSK4%20%E6%A0%B7%E5%8D%B7.pdf\">HSK 4<\/a><\/li>\n<li><a href=\"https:\/\/mock-public-staging.wohui.co\/level-file\/HSK5\/HSK5%20%E6%A0%B7%E5%8D%B7.pdf\">HSK 5<\/a><\/li>\n<li><a href=\"https:\/\/mock-public-staging.wohui.co\/level-file\/HSK6\/HSK6%20%E6%A0%B7%E5%8D%B7.pdf\">HSK 6<\/a><\/li>\n<\/ol>\n<p><a name=\"hsk3\"><\/a><\/p>\n<h3>Spending an hour helping ChatGPT finish HSK 3 in one minute<\/h3>\n<p>In this article, I\u2019m not going to go through every single question of all the four HSK levels, as this would just be tedious. Most of the process is just me feeding texts and questions to ChatGPT, and it spitting out answers in a few seconds. To show you the process, I will go through HSK 3 in some detail.<br \/>\n<a name=\"hsk31\"><\/a><\/p>\n<h4>ChatGPT vs. HSK 3 Reading: Part 1<\/h4>\n<p>Interestingly, there are no instructions on the exam paper for what to do in part one, but the example shown makes it clear that there are six responses (A-F) that each are supposed to be matched with one of six utterances. The example shown is:<\/p>\n<blockquote><p>\u4f60\u77e5\u9053\u600e\u4e48\u53bb\u90a3\u513f\u5417\uff1f<\/p>\n<p>\u5f53\u7136\u3002\u6211\u4eec\u5148\u5750\u516c\u5171\u6c7d\u8f66\uff0c\u7136\u540e\u6362\u5730\u94c1\u3002<\/p><\/blockquote>\n<p>Here, I needed to prompt ChatGPT so it had a reasonable chance of giving the correct answer. For example, I told it explicitly that each option could only be used once. In general, I kept tinkering with prompts until ChatGPT gave an answer according to the instructions. If it did something else, such as translating the questions, I tried again until it produced an answer. Obviously, I did not check if the answer it produced was correct until afterwards!<\/p>\n<p>Here&#8217;s question 1 (note that I included the example as a real question to make it a bit harder):<a href=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-16750 size-full\" src=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-1.png\" alt=\"For this question, there are six responses (A-F) that are supposed to be matched with six utterances (40-45). For each utterance, please list the most appropriate response. Each response can only be used once. A \u7237\u7237\u6559\u4e86\u6211\u5f88\u591a\u6b21\u3002 B \u505a\u4f5c\u4e1a\u9047\u5230\u4e0d\u4f1a\u7684\u8bcd\u8bed\u65f6\uff0c\u4f60\u7528\u94c5\u7b14\u5728\u65c1\u8fb9\u8bb0\u4e00\u4e0b\u3002 C \u6211\u8fd8\u4ee5\u4e3a\u4f60\u5fd8\u4e86\u5462\uff0c\u4f60\u771f\u597d\uff01 D \u51b3\u5b9a\u4e86\u6ca1\uff1f\u53bb\u8fd8\u662f\u4e0d\u53bb\uff1f E \u5f53\u7136\u3002\u6211\u4eec\u5148\u5750\u516c\u5171\u6c7d\u8f66\uff0c\u7136\u540e\u6362\u5730\u94c1\u3002 F \u4f60\u5148\u5403\u4e2a\u82f9\u679c\u5427\uff0c\u6211\u53bb\u7ed9\u4f60\u505a\u9762\u6761\u513f\u3002 40. \u4f60\u77e5\u9053\u600e\u4e48\u53bb\u90a3\u513f\u5417\uff1f \uff08 \uff09 41\uff0e\u751f\u65e5\u5feb\u4e50\uff01\u8fd9\u662f\u6211\u7ed9\u4f60\u4e70\u7684\u793c\u7269\uff0c\u559c\u6b22\u4e0d\u559c\u6b22\uff1f \uff08 \uff09 42\uff0e\u5929\u9634\u4e86\uff0c\u6211\u6015\u4e00\u4f1a\u513f\u8981\u4e0b\u96e8\uff0c\u660e\u5929\u5427\uff1f \uff08 \uff09 43\uff0e\u73b0\u5728\u53bb\u770b\u5b57\u5178\u5427\uff0c\u5b57\u5178\u91cc\u6709\u3002 \uff08 \uff09 44\uff0e\u4f60\u7684\u6e38\u6cf3\u6c34\u5e73\u6700\u8fd1\u63d0\u9ad8\u5f88\u5feb\u554a\u3002 \uff08 \uff09 45\uff0e\u6211\u997f\u4e86\uff0c\u51b0\u7bb1\u91cc\u6709\u4ec0\u4e48\u5403\u7684\u5417\uff1f \uff08 \uff09 ChatGPT: E \u5f53\u7136\u3002\u6211\u4eec\u5148\u5750\u516c\u5171\u6c7d\u8f66\uff0c\u7136\u540e\u6362\u5730\u94c1\u3002 C \u6211\u8fd8\u4ee5\u4e3a\u4f60\u5fd8\u4e86\u5462\uff0c\u4f60\u771f\u597d\uff01 D \u51b3\u5b9a\u4e86\u6ca1\uff1f\u53bb\u8fd8\u662f\u4e0d\u53bb\uff1f B \u505a\u4f5c\u4e1a\u9047\u5230\u4e0d\u4f1a\u7684\u8bcd\u8bed\u65f6\uff0c\u4f60\u7528\u94c5\u7b14\u5728\u65c1\u8fb9\u8bb0\u4e00\u4e0b\u3002 A \u7237\u7237\u6559\u4e86\u6211\u5f88\u591a\u6b21\u3002 F \u4f60\u5148\u5403\u4e2a\u82f9\u679c\u5427\uff0c\u6211\u53bb\u7ed9\u4f60\u505a\u9762\u6761\u513f\u3002\" width=\"1330\" height=\"1169\" srcset=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-1.png 1330w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-1-300x264.png 300w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-1-1024x900.png 1024w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-1-768x675.png 768w\" sizes=\"auto, (max-width: 1330px) 100vw, 1330px\" \/><\/a><\/p>\n<p>Checking the answer key, we can indeed see that <span style=\"color: #008000;\">C, D, B, A, F<\/span> are the correct answer (E is the example, so ignore that). Moving on to questions 46-50:<\/p>\n<p><a href=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-2a.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-16754 size-full\" src=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-2a.png\" alt=\"For this question, there are five responses (A-E) that are supposed to be matched with five utterances (46-50). For each utterance, please list the most appropriate response. Each response can only be used once. A \u5403\u5b8c\u996d\u4ee5\u540e\uff0c\u4f60\u6765\u6d17\u7897\u3002 B \u4ed6\u5728\u9ed1\u677f\u4e0a\u5199\u7684\u5b57\u592a\u5c0f\uff01\u6211\u4eec\u90fd\u770b\u4e0d\u6e05\u695a\uff01 C \u5979\u5df2\u7ecf\u7ed3\u5a5a\u4e86\uff0c\u5b69\u5b50\u90fd\u4e24\u5c81\u4e86\u3002 D \u4ed6\u4eec\u5f88\u8ba4\u771f\u3001\u5f88\u52aa\u529b\u5730\u7ec3\u4e60\u4e86\u4e00\u4e2a\u590f\u5929\u3002 E \u4ed6\u5bf9\u81ea\u5df1\u753b\u7684\u753b\u513f\u603b\u662f\u4e0d\u6ee1\u610f\u3002 46\uff0e\u5b89\u9759\uff0c\u4f60\u9700\u8981\u6362\u4e00\u4e2a\u773c\u955c\u4e86\u3002 47\uff0e\u5176\u5b9e\uff0c\u4e3b\u8981\u662f\u4ed6\u5bf9\u81ea\u5df1\u7684\u8981\u6c42\u592a\u9ad8\u4e86\u3002 48\uff0e\u6211\u51c6\u5907\u7ed9\u4f60\u59b9\u59b9\u4ecb\u7ecd\u4e2a\u7537\u670b\u53cb\u3002 49\uff0e\u4e3a\u4ec0\u4e48\u603b\u662f\u6211\u554a\uff1f 50\uff0e\u4eca\u5929\u7684\u8282\u76ee\u770b\u4e86\u5417\uff1f\u90a3\u4e9b\u5b66\u751f\u7684\u8868\u6f14\u597d\u6781\u4e86\u3002 46\uff0e\u5b89\u9759\uff0c\u4f60\u9700\u8981\u6362\u4e00\u4e2a\u773c\u955c\u4e86\u3002 (E) 47\uff0e\u5176\u5b9e\uff0c\u4e3b\u8981\u662f\u4ed6\u5bf9\u81ea\u5df1\u7684\u8981\u6c42\u592a\u9ad8\u4e86\u3002 (E) 48\uff0e\u6211\u51c6\u5907\u7ed9\u4f60\u59b9\u59b9\u4ecb\u7ecd\u4e2a\u7537\u670b\u53cb\u3002 (C) 49\uff0e\u4e3a\u4ec0\u4e48\u603b\u662f\u6211\u554a\uff1f (A) 50\uff0e\u4eca\u5929\u7684\u8282\u76ee\u770b\u4e86\u5417\uff1f\u90a3\u4e9b\u5b66\u751f\u7684\u8868\u6f14\u597d\u6781\u4e86\u3002 (D)\" width=\"1321\" height=\"1035\" srcset=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-2a.png 1321w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-2a-300x235.png 300w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-2a-1024x802.png 1024w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-2a-768x602.png 768w\" sizes=\"auto, (max-width: 1321px) 100vw, 1321px\" \/><\/a><\/p>\n<p>This is a good example of the hand-holding I mentioned earlier. ChatGPT ignored my instruction to only use each response once and used E twice and didn&#8217;t use B. Thus, I prompted it again:<\/p>\n<p><a href=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-2b.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-16755 size-full\" src=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-2b.png\" alt=\"Please use each option only once. 46\uff0e\u5b89\u9759\uff0c\u4f60\u9700\u8981\u6362\u4e00\u4e2a\u773c\u955c\u4e86\u3002 (A) 47\uff0e\u5176\u5b9e\uff0c\u4e3b\u8981\u662f\u4ed6\u5bf9\u81ea\u5df1\u7684\u8981\u6c42\u592a\u9ad8\u4e86\u3002 (E) 48\uff0e\u6211\u51c6\u5907\u7ed9\u4f60\u59b9\u59b9\u4ecb\u7ecd\u4e2a\u7537\u670b\u53cb\u3002 (C) 49\uff0e\u4e3a\u4ec0\u4e48\u603b\u662f\u6211\u554a\uff1f (D) 50\uff0e\u4eca\u5929\u7684\u8282\u76ee\u770b\u4e86\u5417\uff1f\u90a3\u4e9b\u5b66\u751f\u7684\u8868\u6f14\u597d\u6781\u4e86\u3002 (B)\" width=\"1320\" height=\"435\" srcset=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-2b.png 1320w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-2b-300x99.png 300w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-2b-1024x337.png 1024w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-2b-768x253.png 768w\" sizes=\"auto, (max-width: 1320px) 100vw, 1320px\" \/><\/a><\/p>\n<p>Checking the answer key, we can see that the right answer is actually <span style=\"color: #ff0000;\">B,<\/span> <span style=\"color: #008000;\">E, C,<\/span> <span style=\"color: #ff0000;\">A, D<\/span>. This means that my hand-holding here actually lost the bot points. This is a good opportunity to talk about one of the limitations of ChatGPT, namely that it doesn&#8217;t actually understand anything and it&#8217;s hard to know when it outputs nonsense and when it actually knows what it&#8217;s doing.<\/p>\n<p>We know that it&#8217;s not just guessing, because it gets most questions right (although not in this case), but if I allowed it to output anything and just registered that as its answer, it would in general lose an awful lot of points (I have tried). This is probably because the question format confuses it, not because it doesn&#8217;t have the data to answer the questions correctly. Thus, I decided to always force it to answer according to the instruction; no parley bets allowed.<\/p>\n<p>So far, ChatGPT has scored 7\/10, so much better than mere guessing.<br \/>\n<a name=\"hsk32\"><\/a><\/p>\n<h4>ChatGPT vs. HSK 3 Reading: Part 2<\/h4>\n<p>Moving on to the next part, where you are to insert the right word into the blanks. In this case, I omitted the example, which is why there is no option E:<\/p>\n<p><a href=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-3.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-16757 size-full\" src=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-3.png\" alt=\"For the next question, you are supposed to use the words A, B, C, D or F to fill in the blanks marked with () in the sentences 51-55. Each word can only be used once. A \u523b B \u53cc C \u97f3\u4e50 D \u5176\u4ed6 F \u5e72\u51c0 51\uff0e\u9664\u4e86\u6570\u5b66\uff0c\u5f1f\u5f1f\u7684\uff08 \uff09\u6210\u7ee9\u90fd\u4e0d\u9519\u3002 52\uff0e\u6211\u7279\u522b\u60f3\u4e70\u8fd9\uff08 \uff09\u978b\uff0c\u95ee\u9898\u662f\u6211\u7684\u811a\u592a\u5927\u3002 53\uff0e\u8fd9\u6761\u88e4\u5b50\u6628\u5929\u6d17\u8fc7\u4e86\uff0c\u662f\uff08 \uff09\u7684\u3002 54\uff0e\u73b0\u5728\u662f\u4e09\u70b9\u4e00\uff08 \uff09\uff0c\u522b\u62c5\u5fc3\uff0c\u6211\u4eec\u4e0d\u4f1a\u8fdf\u5230\u3002 55\uff0e\u59d0\u59d0\u4ece\u5c0f\u5c31\u559c\u6b22\u5531\u6b4c\uff0c\u73b0\u5728\u5979\u662f\u4e00\u4f4d\uff08 \uff09\u8001\u5e08\u3002 51\uff0eD \u5176\u4ed6 52\uff0eB \u53cc 53\uff0eF \u5e72\u51c0 54\uff0eA \u523b 55\uff0eC \u97f3\u4e50 \" width=\"1321\" height=\"987\" srcset=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-3.png 1321w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-3-300x224.png 300w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-3-1024x765.png 1024w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-3-768x574.png 768w\" sizes=\"auto, (max-width: 1321px) 100vw, 1321px\" \/><\/a><\/p>\n<p>Checking the key, we can see that this is spot on! <span style=\"color: #008000;\">D, B, F, A, C.<\/span> As we shall see, ChatGPT almost never gets this type of cloze deletion wrong, which is not surprising considering that it can check vast amounts of data for what words are most likely to appear together in sentences like these. It gets the next five right too:<\/p>\n<p><a href=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-4a.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-16759 size-full\" src=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-4a.png\" alt=\"For the next question, you are supposed to use the words A, B, C, E or F to fill in the blanks marked with () in the dialogues 56-60. Each word can only be used once. A \u660e\u767d B \u89d2 C \u88ab D \u7231\u597d E \u529e\u6cd5 F \u751c 56\uff0eA\uff1a\u8fd9\u4e2a\u95ee\u9898\u4f60\u4eec\u51c6\u5907\u4ec0\u4e48\u65f6\u5019\u89e3\u51b3\uff1f B\uff1a\u6211\u4eec\u6b63\u5728\u60f3\uff08 \uff09\uff0c\u4eca\u5929\u5e94\u8be5\u53ef\u4ee5\u89e3\u51b3\u3002 57\uff0eA\uff1a\u600e\u4e48\u6837\uff0c\u542c\uff08 \uff09\u4e86\u5417\uff1f B\uff1a\u5bf9\u4e0d\u8d77\uff0c\u60a8\u8bfb\u5f97\u592a\u5feb\uff0c\u6211\u6ca1\u542c\u61c2\u3002 58\uff0eA\uff1a\u76d8\u5b50\u91cc\u7684\u8089\uff08 \uff09\u90a3\u53ea\u9ec4\u732b\u5403\u4e86\u3002 B\uff1a\u90a3\u4f60\u8be5\u7ed9\u5b83\u51c6\u5907\u70b9\u513f\u6c34\u4e86\u3002 59\uff0eA\uff1a\u83dc\u6709\u70b9\u513f\uff08 \uff09\uff0c\u4f46\u5f88\u597d\u5403\u3002 B\uff1a\u6211\u5988\u5988\u662f\u4e0a\u6d77\u4eba\uff0c\u5979\u505a\u83dc\u559c\u6b22\u653e\u7cd6\u3002 60\uff0eA\uff1a\u4f60\u597d\uff0c\u9999\u8549\u600e\u4e48\u5356\uff1f B\uff1a\u8fd9\u79cd\u4e09\u5757\u4e94\u4e00\u65a4\uff0c\u90a3\u79cd\u4fbf\u5b9c\u4e24\uff08 \uff09\u4e94\u5206\u3002\" width=\"1308\" height=\"1074\" srcset=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-4a.png 1308w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-4a-300x246.png 300w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-4a-1024x841.png 1024w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-4a-768x631.png 768w\" sizes=\"auto, (max-width: 1308px) 100vw, 1308px\" \/><\/a> <a href=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-4b.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-16760 size-full\" src=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-4b.png\" alt=\"E A C F B\" width=\"1327\" height=\"283\" srcset=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-4b.png 1327w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-4b-300x64.png 300w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-4b-1024x218.png 1024w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-4b-768x164.png 768w\" sizes=\"auto, (max-width: 1327px) 100vw, 1327px\" \/><\/a><br \/>\n<a name=\"hsk33\"><\/a><\/p>\n<h4>ChatGPT vs. HSK 3 Reading: Part 3<\/h4>\n<p>The final part of the reading section consists of short texts followed by reading comprehension questions. We can expect thees to be harder, because it&#8217;s not longer just a matter of seeing which option is statistically the most likely based on a huge dataset of written Chinese. Here&#8217;s the example given on the mock exam:<\/p>\n<blockquote><p>\u60a8\u662f\u6765\u53c2\u52a0\u4eca\u5929\u4f1a\u8bae\u7684\u5417\uff1f\u60a8\u6765\u65e9\u4e86\u4e00\u70b9\u513f\uff0c\u73b0\u5728\u624d\u516b\u70b9\u534a\u3002\u60a8\u5148\u8fdb\u6765\u5750\u5427\u3002<\/p>\n<p>\u2605 \u4f1a\u8bae\u6700\u53ef\u80fd\u51e0\u70b9\u5f00\u59cb\uff1f<\/p>\n<p>A 8 \u70b9<br \/>\nB 8 \u70b9\u534a<br \/>\nC 9 \u70b9<\/p><\/blockquote>\n<p>Here, we might expect ChatGPT to do worse, because this is no longer just a matter of judging which resulting chunk of text is statistically the most likely. But no, it passes with flying colours:<\/p>\n<p><a href=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-5a.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-16761 size-full\" src=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-5a.png\" alt=\"For this question, please answer the question marked with \u2605 based on the text, using the most appropriate alternative. 61\uff0e\u4e2d\u56fd\u4eba\u7ecf\u5e38\u8bf4\uff1a\u65e9\u996d\u8981\u5403\u597d\uff0c\u5348\u996d\u8981\u5403\u9971\uff0c\u665a\u996d\u8981\u5403\u5c11\u3002 \u2605 \u6839\u636e\u8fd9\u53e5\u8bdd\uff0c\u53ef\u4ee5\u77e5\u9053\uff1a A \u65e9\u996d\u8981\u5c11\u5403 B \u5348\u996d\u8981\u591a\u5403 C \u4e0d\u8981\u5403\u665a\u996d 62\uff0e\u516c\u53f8\u6765\u4e86\u4e00\u4f4d\u65b0\u540c\u4e8b\uff0c\u957f\u5f97\u8ddf\u6211\u6709\u70b9\u513f\u50cf\uff0c\u800c\u4e14\u6211\u4eec\u90fd\u59d3\u738b\uff0c\u5f88\u591a\u4eba\u603b\u662f\u7b11\u7740\u95ee\u6211\uff1a \u201c\u65b0\u6765\u7684\u540c\u4e8b\u662f\u4e0d\u662f\u4f60\u54e5\u54e5\uff1f\u201d \u2605 \u65b0\u6765\u7684\u540c\u4e8b\uff1a A \u662f\u6211\u54e5 B \u957f\u5f97\u50cf\u6211 C \u957f\u5f97\u50cf\u6211\u5f1f\u5f1f 63\uff0e\u5317\u4eac\u7684\u79cb\u5929\u6bd4\u8f83\u77ed\uff0c\u4f46\u8fd9\u662f\u5317\u4eac\u6700\u597d\u7684\u5b63\u8282\u3002 \u79cb\u5929\u7684\u5317\u4eac\u4e0d\u51b7\u4e5f\u4e0d\u70ed\uff0c\u4e0b\u96e8\u7684\u65f6\u5019\u4e0d\u591a\uff0c\u8fd9\u65f6\u5019\u53bb\u5317\u4eac\u65c5\u6e38\u6700\u597d\u3002 \u5317\u4eac\u7684\u6625\u5929\u4e5f\u5f88\u6f02\u4eae\uff0c\u53ea\u662f\u6709\u65f6 \u5019\u4f1a\u522e\u5927\u98ce\u3002 \u2605 \u5317\u4eac\u7684\u79cb\u5929\uff1a A \u5f88\u8212\u670d B \u975e\u5e38\u70ed C \u7ecf\u5e38\u522e\u98ce 64\uff0e\u5f20\u5148\u751f\uff0c\u60a8\u5230\u996d\u5e97\u4ee5\u540e\uff0c\u5148\u4f11\u606f\u4e00\u4e0b\u3002 \u4e2d\u5348\u6211\u4eec\u4e00\u8d77\u5403\u5348\u996d\uff0c\u4e0b\u5348 4 \u70b9\u4ee5\u524d\u6ca1\u6709\u4ec0\u4e48\u4e8b\uff0c\u5982\u679c\u60a8\u613f\u610f\uff0c\u6211\u53ef\u4ee5\u5e26\u60a8\u5230\u9644\u8fd1\u770b\u770b\u3002 5 \u70b9\uff0c\u6211\u4eec\u7ecf\u7406\u548c\u60a8\u89c1\u9762\uff0c\u665a\u4e0a\u7ecf\u7406\u8bf7\u60a8\u5403\u665a\u996d\u3002 \u2605 \u5f20\u5148\u751f 5 \u70b9\u505a\u4ec0\u4e48\uff1f A \u548c\u7ecf\u7406\u89c1\u9762 B \u5230\u5916\u9762\u53bb\u770b\u770b C \u548c\u7ecf\u7406\u4e00\u8d77\u5403\u996d B \u5348\u996d\u8981\u591a\u5403 B \u957f\u5f97\u50cf\u6211 A \u5f88\u8212\u670d A \u548c\u7ecf\u7406\u89c1\u9762\" width=\"656\" height=\"1083\" srcset=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-5a.png 656w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-5a-182x300.png 182w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-5a-620x1024.png 620w\" sizes=\"auto, (max-width: 656px) 100vw, 656px\" \/><\/a> <a href=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-5b.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-16762 size-full\" src=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-5b.png\" alt=\"For this question, please answer the question marked with \u2605 based on the text, using the most appropriate alternative. 65\uff0e\u5c0f\u674e\uff0c\u6d17\u624b\u95f4\u5728\u4e00\u697c\u4e1c\u8fb9\uff0c\u5982\u679c\u6709\u5ba2\u4eba\u8981\u53bb\uff0c\u4f60\u5e26\u4ed6\u4eec\u53bb\u3002\u8fd8\u6709\uff0c\u6ce8\u610f\u6d17 \u624b\u95f4\u7684\u706f\u4e0d\u8981\u5173\u3002 \u2605 \u6839\u636e\u8fd9\u6bb5\u8bdd\uff0c\u53ef\u4ee5\u77e5\u9053\uff1a A \u5c0f\u674e\u662f\u5ba2\u4eba B \u5c0f\u674e\u8868\u793a\u540c\u610f C \u522b\u5173\u6d17\u624b\u95f4\u7684\u706f 66\uff0e\u4e00\u5e74\u7ea7\u4e8c\u73ed\u7684\u8003\u8bd5\u5df2\u7ecf\u7ed3\u675f\u4e86\uff0c\u6211\u542c\u5927\u5bb6\u8bf4\uff0c\u867d\u7136\u9898\u5f88\u591a\uff0c\u4f46\u4e0d\u96be\uff0c\u5f88\u7b80 \u5355\u3002 \u2605 \u8fd9\u6b21\u8003\u8bd5\uff1a A \u5f88\u96be B \u9898\u5f88\u591a C \u65f6\u95f4\u4e0d\u957f 67\uff0e\u6211\u5bf9\u5916\u9762\u7684\u4e16\u754c\u5f88\u6709\u5174\u8da3\uff0c\u6211\u5e0c\u671b\u6709\u673a\u4f1a\u5230\u522b\u7684\u56fd\u5bb6\u770b\u4e00\u770b\uff0c\u4e86\u89e3\u5b83\u4eec\u4e0d\u540c\u7684\u6587\u5316\u3002 \u2605 \u6211\u5e0c\u671b\uff1a A \u5b66\u4e60\u666e\u901a\u8bdd B \u6709\u5f88\u591a\u8282\u65e5 C \u53bb\u56fd\u5916\u770b\u770b 68\uff0e\u81ea\u884c\u8f66\uff1f\u6ca1\u95ee\u9898\uff0c\u4f60\u522b\u5ba2\u6c14\u3002\u5c31\u5728\u697c\u4e0b\uff0c\u5c31\u662f\u90a3\u8f86\u84dd\u8272\u7684\u3002 \u6211\u8fd9\u51e0\u5929\u4e0d\u9a91\uff0c\u4f60\u4e0d\u7528\u6025\u7740\u8fd8\u3002 \u2605 \u90a3\u8f86\u81ea\u884c\u8f66\uff1a A \u574f\u4e86 B \u662f\u84dd\u8272\u7684 C \u662f\u522b\u4eba\u7684 69\uff0e\u4e24\u5e74\u4e0d\u89c1\uff0c\u6ca1\u60f3\u5230\u4ed6\u53d8\u5316\u8fd9\u4e48\u5927\uff0c\u6bd4\u4ee5\u524d\u7626\u4e86\u5f88\u591a\uff0c\u4f46\u548c\u4ee5\u524d\u4e00\u6837\u7684\u662f\uff0c\u4ed6\u8fd8\u662f\u90a3\u4e48\u70ed\u60c5\u3001\u5feb\u4e50\u3001\u5173\u5fc3\u522b\u4eba\u3002 \u2605 \u4ed6\u4ee5\u524d\u600e\u4e48\u6837\uff1f A \u53c8\u77ee\u53c8\u7626 B \u5bb9\u6613\u751f\u6c14 C \u70ed\u60c5\u3001\u5feb\u4e50 70\uff0e\u4e0b\u4e86\u98de\u673a\uff0c\u5750\u51fa\u79df\u8f66\u7684\u65f6\u5019\uff0c\u6211\u628a\u884c\u674e\u7bb1\u653e\u5728\u4e86\u8f66\u7bb1\u91cc\u3002 \u4e0b\u8f66\u65f6\uff0c\u6211\u5fd8\u4e86\u62ff\u884c\u674e\u7bb1\uff0c\u91cc\u9762\u6709\u5f88\u591a\u91cd\u8981\u7684\u4e1c\u897f\u3002 \u4f46\u662f\uff0c\u6211\u6709\u51fa\u79df\u8f66\u7968\uff0c\u6211\u76f8\u4fe1\u80fd\u627e\u5230\u6211\u7684\u884c\u674e\u7bb1\u3002 \u2605 \u6211\u7684\u884c\u674e\u7bb1\u73b0\u5728\u6700\u53ef\u80fd\u5728\uff1a A \u673a\u573a B \u98de\u673a\u4e0a C \u51fa\u79df\u8f66\u4e0a C \u522b\u5173\u6d17\u624b\u95f4\u7684\u706f B \u9898\u5f88\u591a C \u53bb\u56fd\u5916\u770b\u770b B \u662f\u84dd\u8272\u7684 C \u70ed\u60c5\u3001\u5feb\u4e50 C \u51fa\u79df\u8f66\u4e0a\" width=\"657\" height=\"937\" srcset=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-5b.png 657w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-5b-210x300.png 210w\" sizes=\"auto, (max-width: 657px) 100vw, 657px\" \/><\/a><\/p>\n<p><span style=\"color: #008000;\">B, B, A, A, C, B, C, B, C, C<\/span>. All correct.<br \/>\n<a name=\"copying\"><\/a><\/p>\n<h4>But wait, isn&#8217;t it just copying the answers?<\/h4>\n<p><a href=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/download-16.jpeg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignright wp-image-16770 size-medium\" src=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/download-16-300x300.jpeg\" alt=\"\" width=\"300\" height=\"300\" srcset=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/download-16-300x300.jpeg 300w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/download-16-150x150.jpeg 150w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/download-16.jpeg 768w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a>When seeing ChatGPT in action the first time, many people think that it must be copying existing text from the internet. This is not the case, but it is a valid question, because the mock exams I&#8221;m using have been available online for years, so doesn&#8217;t ChatGPT know the answers based on that?<\/p>\n<p>No. To begin with, the answers are only given as number-letter combinations at the end of the mock exam document, so the answers aren&#8217;t written out. Okay, but wait, there probably are people who have explained the correct answers to the mock exam questions online. Still no; it&#8217;s not copying anything.<\/p>\n<p>You can easily check this yourself by changing the text in a way that changes which answer is the correct one. If you do, ChatGPT will still give you the correct answer based on the newly created and therefore unique text.<\/p>\n<p>Obviously, I didn&#8217;t try modifying every single text in the exam, but I tried it enough to satisfy my curiosity and to be able to write this paragraph in good conscience. Also, if the correct answers were available, it&#8217;s hard to explain why it would get some questions wrong<\/p>\n<p>I have also tried using ChatGPT to answer similar reading questions on exams I or my colleagues at university have created and are extremely unlikely to be part of the training data. ChatGPT performed on par with what it does here, so I have reason to suspect that the results are due to the answers being part of the training data.<br \/>\n<a name=\"hsk3results\"><\/a><\/p>\n<h4>ChatGPT got 27\/30 on HSK 3<\/h4>\n<p>Here&#8217;s the scorecard for HSK 3:<\/p>\n<p><a href=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-stats.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-16763 size-full\" src=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-stats.png\" alt=\"ChatGPT got 27 out of 30 on HSK 3 reading.\" width=\"245\" height=\"706\" srcset=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-stats.png 245w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk3-stats-104x300.png 104w\" sizes=\"auto, (max-width: 245px) 100vw, 245px\" \/><\/a><br \/>\n<a name=\"hsk45\"><\/a><\/p>\n<h3>ChatGPT vs. HSK 4 and HSK 5 reading<\/h3>\n<p>Like I said earlier, I&#8217;m not going to go go through the process of taking screenshots of my interactions with ChatGPT for all the questions on every level. It took many hours to just collect the data here and posting screenshots would have takes hours more, without adding any new insights. Instead, I will give you the results and discuss them. Remember, you can always download the mock exams to check which questions it got wrong if you&#8217;re curious! <a href=\"https:\/\/docs.google.com\/spreadsheets\/d\/1OBQbaMaVdVNbRp4cQNzmbDNn-xfS2PhcmQYMtG1vD0E\/edit?usp=sharing\">Here&#8217;s a link to my spreadsheet.<\/a><\/p>\n<p><a href=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk34-stats.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-16764 size-full\" src=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk34-stats.png\" alt=\"ChatGPT got 35 out of 40 on HSK 4 reading, and 38 out of 45 on HSK 5 reading.\" width=\"492\" height=\"1025\" srcset=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk34-stats.png 492w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk34-stats-144x300.png 144w\" sizes=\"auto, (max-width: 492px) 100vw, 492px\" \/><\/a><\/p>\n<p>In general, ChatGPT excels at matching questions and simple cloze deletion, but it sometimes struggles with more complex questions.For example, it didn\u2019t do very well on part 1\u00a0 of HSK 5 reading, where it\u2019s supposed to pick sets of three characters that fit into three gaps in a text. Here&#8217;s an example:<\/p>\n<blockquote><p>\u5728\u9ad8\u901f\u884c\u9a76\u7684\u706b\u8f66\u4e0a\uff0c\u6709\u4e00\u4f4d\u8001\u4eba\u4e0d\u5c0f\u5fc3\u628a\u521a\u4e70\u7684\u65b0\u978b\u4ece\u7a97\u53e3\u6389\u4e0b\u53bb\u4e00\u53ea\uff0c<br \/>\n\u5468\u56f4\u7684\u4eba\u90fd\u89c9\u5f97\u5f88 46 \u3002\u6ca1\u60f3\u5230\u8001\u4eba\u628a\u53e6\u4e00\u53ea\u978b\u4e5f\u4ece\u7a97\u53e3\u6254\u4e86\u51fa\u53bb\u3002\u4ed6\u7684\u884c\u4e3a\u8ba9<br \/>\n\u5468\u56f4\u7684\u4eba\u611f\u5230\u5f88\u5403\u60ca\u3002\u8fd9\u65f6\u5019\uff0c\u8001\u4eba\u7b11\u7740 47 \u8bf4\uff1a\u201c\u5269\u4e0b\u7684\u90a3\u53ea\u978b\u65e0\u8bba\u591a\u4e48\u597d\uff0c<br \/>\n\u591a\u4e48\u8d35\uff0c\u591a\u4e48\u9002\u5408\u6211\u7a7f\uff0c\u53ef\u5bf9\u6211\u6765\u8bf4\u5df2\u7ecf\u6ca1\u6709\u4e00\u70b9\u513f\u7528\u5904\u4e86\u3002\u6211\u628a\u5b83\u6254\u4e86\u51fa\u53bb\uff0c<br \/>\n\u5c31\u6709\u4eba\u53ef\u80fd 48 \u5230\u4e00\u53cc\u978b\u5b50\uff0c\u8bf4\u4e0d\u5b9a\u4ed6\u8fd8\u53ef\u4ee5\u7a7f\u5462\u3002\u201d<\/p>\n<p>46\uff0eA \u6d6a\u8d39 B \u4f24\u5fc3 C \u53ef\u60dc D \u75db\u82e6<br \/>\n47\uff0eA \u89e3\u91ca B \u7406\u89e3 C \u5efa\u8bae D \u601d\u8003<br \/>\n48\uff0eA \u6361 B \u9009 C \u4e70 D \u6362<\/p><\/blockquote>\n<p>It\u2019s hard to prompt the bot to do the right thing here. One way of doing it would have been to present three versions of the text with each set inserted into the gaps but this would have been very time-consuming to do for every question, so I did\u2019t do that. Even so, it only got two of these wrong.<\/p>\n<p>Another thing worth repeating is that ChatGPT doesn&#8217;t think and can&#8217;t reason logically. This means that some complex reading questions are hard to answer, something that becomes more relevant the more advanced the reading questions become.<\/p>\n<p>As you all know, reading on a basic level is just about extracting information that is clearly presented in the text, but more advanced reading is about inferring an answer fro what&#8217;s said in the text, even if the answer isn&#8217;t explicitly presented in the text. This becomes very relevant on HSK 6, so let&#8217;s move on!<br \/>\n<a name=\"hsk6\"><\/a><\/p>\n<h3>ChatGPT vs. HSK 6<\/h3>\n<p>As I mentioned, ChatGPT doesn\u2019t actually think, even though it certainly feels like it does at times (for a related philosophical question, see <a href=\"https:\/\/en.wikipedia.org\/wiki\/Chinese_room\">Chinese Room<\/a> on Wikipedia, or read <a href=\"https:\/\/amzn.to\/3xe80DA\"><em>Blindsight<\/em> by Peter Watts<\/a>). This limitation becomes very obvious on many HSK 6 questions, especially those where the test is constructed to trick you into thinking that something is the answer unless you really understand what it means.<\/p>\n<p>Consequently, ChatGPT did not do as well on HSK 6, and it did particularly badly on parts 1 and 4. When you look at the data here, remember that most questions have \u00bc chance of being correct by pure chance.<\/p>\n<p><a href=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk6-stats.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-16765 size-full\" src=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk6-stats.png\" alt=\"ChatGPT got 30 out of 50 on HSK 6 reading.\" width=\"245\" height=\"1136\" srcset=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk6-stats.png 245w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk6-stats-65x300.png 65w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/hsk6-stats-221x1024.png 221w\" sizes=\"auto, (max-width: 245px) 100vw, 245px\" \/><\/a><\/p>\n<p>While this type of question isn&#8217;t common on the HSK, I tried to run several more complex reading comprehension questions through ChatGPT, and it did very badly in some cases (worse than guessing). One question we used on an exam featured an explanation of the <a href=\"https:\/\/en.wikipedia.org\/wiki\/Monty_Hall_problem\">Monty Hall problem<\/a>, and then asked some basic questions about it,\u00a0 including a &#8220;choose an appropriate title for this text&#8221;. ChatGPT got every single question wrong. It&#8217;s clear that question type matters quite a lot, but it&#8217;s beyond the scope of this article to probe this further.<\/p>\n<p><a href=\"https:\/\/xkcd.com\/1282\/\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-16777\" src=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/monty_hall.png\" alt=\"\" width=\"596\" height=\"207\" srcset=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/monty_hall.png 596w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/monty_hall-300x104.png 300w\" sizes=\"auto, (max-width: 596px) 100vw, 596px\" \/><\/a><\/p>\n<p><a name=\"so\"><\/a><\/p>\n<h3>So can ChatGPT pass the HSK?<\/h3>\n<p><a href=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/download-7.jpeg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignright wp-image-16772 size-medium\" src=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/download-7-300x300.jpeg\" alt=\"\" width=\"300\" height=\"300\" srcset=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/download-7-300x300.jpeg 300w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/download-7-150x150.jpeg 150w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/download-7.jpeg 768w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a>Well, if we mean if it can give the correct answers to multiple-choice reading questions, the answer is a resounding \u201cyes\u201d, at least if the questions are straight up, honest reading questions not deliberately designed to trick you.<\/p>\n<p>This is quite amazing! Going into this project, I expected it to do very well on matching and fill-in-the-blanks types of questions, which it did. I also expected it to struggle with trickier questions, which it also did. However, I e expected it to struggle a lot more than it did!<\/p>\n<p>I was also blown away by the accuracy of most of the reading comprehension questions. Sure, it\u2019s one thing to be able to fill in the blanks or match words, but actually, content-based reading questions also went surprisingly well!<\/p>\n<p>I should have predicted that, though, because ChatGPT also does pretty well on most take-home exam style questions, as shown in multiple YouTube videos (search for your area of expertise and ChatGPT and you\u2019ll probably find something).<\/p>\n<p>It should be pointed out that it would be premature to say that ChatGPT could pass HSK, even ignoring the fact that it needs human guidance to format the questions properly, because the HSK is a test you either pass or fail the whole exam, not just the reading part. However, if we assume that the percentage of correct answers required for the whole exam were required for each part, ChatGPT would breeze through HSK 3-5. It would also pass HSK 6, although not with as safe a margin.<br \/>\n<a name=\"means\"><\/a><\/p>\n<h3>What does this mean?<\/h3>\n<p><a href=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/download-4.jpeg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignright size-medium wp-image-16779\" src=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/download-4-300x300.jpeg\" alt=\"\" width=\"300\" height=\"300\" srcset=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/download-4-300x300.jpeg 300w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/download-4-150x150.jpeg 150w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/download-4.jpeg 512w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a>First and foremost, it means that you shouldn\u2019t ignore ChatGPT or its competitors. If you haven\u2019t taken recent AI development seriously in spite of (or maybe because of) the hype in the news, it\u2019s time that you do. If you haven\u2019t tried ChatGPT yourself, you should.<\/p>\n<p>It&#8217;s is already quite useful for many tasks, and AI will only get better with time. The Rubicon is crossed, the die is cast, and the machine rebellion is drawing nigh. Or something.<\/p>\n<p>It also means that it\u2019s become even easier to cheat on exams if you have access to the internet. To language teachers like me, this is not really a big thing, because it\u2019s pretty much the same problem as we\u2019ve had with Google Translate for more than a decade, just a bit wider in scope so it now affects all other subjects too.<\/p>\n<p>Additionally, I\u2019m mostly interested how we can leverage tools like ChatGPT and Google Translate to our advantage as language learners and language teachers. If you want to cheat on an exam, that&#8217;s your problem, and whatever you\u2019re doing, it does\u2019t count as language learning and it&#8217;s outside the scope of Hacking Chinese.<\/p>\n<p>If you want good grades\u00a0<em>and\u00a0<\/em>learn the language at the same time, you can check this article:<\/p>\n<blockquote class=\"wp-embedded-content\" data-secret=\"Q3ujfNRb44\"><p><a href=\"https:\/\/www.hackingchinese.com\/studying-chinese-when-your-grades-matter\/\">How to get good grades when studying Chinese<\/a><\/p><\/blockquote>\n<p><iframe loading=\"lazy\" class=\"wp-embedded-content\" sandbox=\"allow-scripts\" security=\"restricted\" style=\"position: absolute; clip: rect(1px, 1px, 1px, 1px);\" title=\"&#8220;How to get good grades when studying Chinese&#8221; &#8212; Hacking Chinese\" src=\"https:\/\/www.hackingchinese.com\/studying-chinese-when-your-grades-matter\/embed\/#?secret=Dh7U9onnZW#?secret=Q3ujfNRb44\" data-secret=\"Q3ujfNRb44\" width=\"500\" height=\"282\" frameborder=\"0\" marginwidth=\"0\" marginheight=\"0\" scrolling=\"no\"><\/iframe><\/p>\n<p><a name=\"learnteach\"><\/a><\/p>\n<p>&nbsp;<\/p>\n<h3>How to use ChatGPT to learn and teach Chinese<\/h3>\n<p><a href=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/download-25.jpeg\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-16771 size-medium alignright\" src=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/download-25-300x300.jpeg\" alt=\"\" width=\"300\" height=\"300\" srcset=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/download-25-300x300.jpeg 300w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/download-25-150x150.jpeg 150w, https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/download-25.jpeg 512w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a>There are many ways of using ChatGPT to learn or teach Chinese. I have spent a lot of time experimenting with it in the past few months, but rather than posting something quick and dirty, I want to collect good ideas and leave some time for reflection before I write something.<\/p>\n<p>This means that while this article ends here, I will write more about how you can use ChatGPT to learn and teach Chinese in the near future. To be able to do that well, I need your help! If you have used ChatGPT for learning or teaching Chinese, please leave a comment below or send me an email:<\/p>\n<ul>\n<li aria-level=\"1\">What did you try?<\/li>\n<li aria-level=\"1\">What worked well?<\/li>\n<li aria-level=\"1\">What didn\u2019t work so well?<\/li>\n<\/ul>\n<p><em>To match the theme of AI, the images used in this article were created using <a href=\"https:\/\/stablediffusionweb.com\/\">Stable Diffusion<\/a> with various prompts related to robots and reading. The &#8220;HSK&#8221; on the book cover on one of the images was added manually afterwards, as SD is very bad at text.<\/em><\/p>\n<h3>Further reading about HSK on Hacking Chinese<\/h3>\n<blockquote class=\"wp-embedded-content\" data-secret=\"EnGs1CMbDp\"><p><a href=\"https:\/\/www.hackingchinese.com\/using-the-hsk-as-a-roadmap-to-learning-chinese\/\">Using the HSK as a roadmap to learning Chinese<\/a><\/p><\/blockquote>\n<p><iframe loading=\"lazy\" class=\"wp-embedded-content\" sandbox=\"allow-scripts\" security=\"restricted\" style=\"position: absolute; clip: rect(1px, 1px, 1px, 1px);\" title=\"&#8220;Using the HSK as a roadmap to learning Chinese&#8221; &#8212; Hacking Chinese\" src=\"https:\/\/www.hackingchinese.com\/using-the-hsk-as-a-roadmap-to-learning-chinese\/embed\/#?secret=5H2Dgj7WCb#?secret=EnGs1CMbDp\" data-secret=\"EnGs1CMbDp\" width=\"500\" height=\"282\" frameborder=\"0\" marginwidth=\"0\" marginheight=\"0\" scrolling=\"no\"><\/iframe><\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>ChatGPT has been all over the news for its remarkable ability to interact in a human-like manner, understand questions and respond in a meaningful way. It has even been used to pass university exams. But how good is it at Chinese? Can it pass the HSK?<\/p>\n","protected":false},"author":1,"featured_media":16767,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3,5,6,10],"tags":[1246,1247,1245,105,197,264,1248,1100],"class_list":["post-16743","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-advanced","category-beginner","category-distinctively-chinese","category-intermediate","tag-ai","tag-chatbot","tag-chatgpt","tag-cheating","tag-exams","tag-hsk","tag-openai","tag-podcast-episode"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Can ChatGPT pass the HSK?<\/title>\n<meta name=\"description\" content=\"ChatGPT has been hyped for its ability to interact in a human-like manner and even to pass university exams. But can ChatGPT pass the HSK?\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.hackingchinese.com\/can-chatgpt-pass-the-hsk\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Can ChatGPT pass the HSK?\" \/>\n<meta property=\"og:description\" content=\"ChatGPT has been hyped for its ability to interact in a human-like manner and even to pass university exams. But can ChatGPT pass the HSK?\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.hackingchinese.com\/can-chatgpt-pass-the-hsk\/\" \/>\n<meta property=\"og:site_name\" content=\"Hacking Chinese\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/HackingChinese\" \/>\n<meta property=\"article:published_time\" content=\"2023-02-13T08:54:58+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-02-13T09:13:32+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/robot-reading.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"768\" \/>\n\t<meta property=\"og:image:height\" content=\"768\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Olle Linge\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@HackingChinese\" \/>\n<meta name=\"twitter:site\" content=\"@HackingChinese\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Olle Linge\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"18 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.hackingchinese.com\\\/can-chatgpt-pass-the-hsk\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.hackingchinese.com\\\/can-chatgpt-pass-the-hsk\\\/\"},\"author\":{\"name\":\"Olle Linge\",\"@id\":\"https:\\\/\\\/www.hackingchinese.com\\\/#\\\/schema\\\/person\\\/fd696a7384c7de665cc9d67c15205b15\"},\"headline\":\"Can ChatGPT pass the HSK?\",\"datePublished\":\"2023-02-13T08:54:58+00:00\",\"dateModified\":\"2023-02-13T09:13:32+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.hackingchinese.com\\\/can-chatgpt-pass-the-hsk\\\/\"},\"wordCount\":3003,\"commentCount\":6,\"publisher\":{\"@id\":\"https:\\\/\\\/www.hackingchinese.com\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/www.hackingchinese.com\\\/can-chatgpt-pass-the-hsk\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.hackingchinese.com\\\/wp-content\\\/uploads\\\/2023\\\/02\\\/robot-reading.jpeg\",\"keywords\":[\"AI\",\"Chatbot\",\"ChatGPT\",\"Cheating\",\"Exams\",\"HSK\",\"OpenAI\",\"Podcast episode\"],\"articleSection\":[\"Advanced\",\"Beginner\",\"Distinctively Chinese\",\"Intermediate\"],\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/www.hackingchinese.com\\\/can-chatgpt-pass-the-hsk\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.hackingchinese.com\\\/can-chatgpt-pass-the-hsk\\\/\",\"url\":\"https:\\\/\\\/www.hackingchinese.com\\\/can-chatgpt-pass-the-hsk\\\/\",\"name\":\"Can ChatGPT pass the HSK?\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.hackingchinese.com\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.hackingchinese.com\\\/can-chatgpt-pass-the-hsk\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.hackingchinese.com\\\/can-chatgpt-pass-the-hsk\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.hackingchinese.com\\\/wp-content\\\/uploads\\\/2023\\\/02\\\/robot-reading.jpeg\",\"datePublished\":\"2023-02-13T08:54:58+00:00\",\"dateModified\":\"2023-02-13T09:13:32+00:00\",\"description\":\"ChatGPT has been hyped for its ability to interact in a human-like manner and even to pass university exams. But can ChatGPT pass the HSK?\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.hackingchinese.com\\\/can-chatgpt-pass-the-hsk\\\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.hackingchinese.com\\\/can-chatgpt-pass-the-hsk\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/www.hackingchinese.com\\\/can-chatgpt-pass-the-hsk\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.hackingchinese.com\\\/wp-content\\\/uploads\\\/2023\\\/02\\\/robot-reading.jpeg\",\"contentUrl\":\"https:\\\/\\\/www.hackingchinese.com\\\/wp-content\\\/uploads\\\/2023\\\/02\\\/robot-reading.jpeg\",\"width\":768,\"height\":768,\"caption\":\"Robot reading. Created with Stable Diffusion and some GIMP editing for the book cover.\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.hackingchinese.com\\\/can-chatgpt-pass-the-hsk\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.hackingchinese.com\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Can ChatGPT pass the HSK?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.hackingchinese.com\\\/#website\",\"url\":\"https:\\\/\\\/www.hackingchinese.com\\\/\",\"name\":\"Hacking Chinese\",\"description\":\"A better way of learning Mandarin\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.hackingchinese.com\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.hackingchinese.com\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.hackingchinese.com\\\/#organization\",\"name\":\"Hacking Chinese\",\"url\":\"https:\\\/\\\/www.hackingchinese.com\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/www.hackingchinese.com\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.hackingchinese.com\\\/wp-content\\\/uploads\\\/2010\\\/09\\\/square-stamp-1000.png\",\"contentUrl\":\"https:\\\/\\\/www.hackingchinese.com\\\/wp-content\\\/uploads\\\/2010\\\/09\\\/square-stamp-1000.png\",\"width\":1000,\"height\":1000,\"caption\":\"Hacking Chinese\"},\"image\":{\"@id\":\"https:\\\/\\\/www.hackingchinese.com\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/HackingChinese\",\"https:\\\/\\\/x.com\\\/HackingChinese\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.hackingchinese.com\\\/#\\\/schema\\\/person\\\/fd696a7384c7de665cc9d67c15205b15\",\"name\":\"Olle Linge\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/7d60e40795941ec743c532d9ba9a94d261cd89f55ab4a7a0a8271040e7046559?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/7d60e40795941ec743c532d9ba9a94d261cd89f55ab4a7a0a8271040e7046559?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/7d60e40795941ec743c532d9ba9a94d261cd89f55ab4a7a0a8271040e7046559?s=96&d=mm&r=g\",\"caption\":\"Olle Linge\"},\"description\":\"Hi! My name is Olle Linge (\u51cc\u96f2\u9f8d) and I'm the creator and editor of Hacking Chinese. Read more about the website and me on the About page.\",\"sameAs\":[\"http:\\\/\\\/www.hackingchinese.com\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Can ChatGPT pass the HSK?","description":"ChatGPT has been hyped for its ability to interact in a human-like manner and even to pass university exams. But can ChatGPT pass the HSK?","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.hackingchinese.com\/can-chatgpt-pass-the-hsk\/","og_locale":"en_GB","og_type":"article","og_title":"Can ChatGPT pass the HSK?","og_description":"ChatGPT has been hyped for its ability to interact in a human-like manner and even to pass university exams. But can ChatGPT pass the HSK?","og_url":"https:\/\/www.hackingchinese.com\/can-chatgpt-pass-the-hsk\/","og_site_name":"Hacking Chinese","article_publisher":"https:\/\/www.facebook.com\/HackingChinese","article_published_time":"2023-02-13T08:54:58+00:00","article_modified_time":"2023-02-13T09:13:32+00:00","og_image":[{"width":768,"height":768,"url":"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/robot-reading.jpeg","type":"image\/jpeg"}],"author":"Olle Linge","twitter_card":"summary_large_image","twitter_creator":"@HackingChinese","twitter_site":"@HackingChinese","twitter_misc":{"Written by":"Olle Linge","Estimated reading time":"18 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.hackingchinese.com\/can-chatgpt-pass-the-hsk\/#article","isPartOf":{"@id":"https:\/\/www.hackingchinese.com\/can-chatgpt-pass-the-hsk\/"},"author":{"name":"Olle Linge","@id":"https:\/\/www.hackingchinese.com\/#\/schema\/person\/fd696a7384c7de665cc9d67c15205b15"},"headline":"Can ChatGPT pass the HSK?","datePublished":"2023-02-13T08:54:58+00:00","dateModified":"2023-02-13T09:13:32+00:00","mainEntityOfPage":{"@id":"https:\/\/www.hackingchinese.com\/can-chatgpt-pass-the-hsk\/"},"wordCount":3003,"commentCount":6,"publisher":{"@id":"https:\/\/www.hackingchinese.com\/#organization"},"image":{"@id":"https:\/\/www.hackingchinese.com\/can-chatgpt-pass-the-hsk\/#primaryimage"},"thumbnailUrl":"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/robot-reading.jpeg","keywords":["AI","Chatbot","ChatGPT","Cheating","Exams","HSK","OpenAI","Podcast episode"],"articleSection":["Advanced","Beginner","Distinctively Chinese","Intermediate"],"inLanguage":"en-GB","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.hackingchinese.com\/can-chatgpt-pass-the-hsk\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.hackingchinese.com\/can-chatgpt-pass-the-hsk\/","url":"https:\/\/www.hackingchinese.com\/can-chatgpt-pass-the-hsk\/","name":"Can ChatGPT pass the HSK?","isPartOf":{"@id":"https:\/\/www.hackingchinese.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.hackingchinese.com\/can-chatgpt-pass-the-hsk\/#primaryimage"},"image":{"@id":"https:\/\/www.hackingchinese.com\/can-chatgpt-pass-the-hsk\/#primaryimage"},"thumbnailUrl":"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/robot-reading.jpeg","datePublished":"2023-02-13T08:54:58+00:00","dateModified":"2023-02-13T09:13:32+00:00","description":"ChatGPT has been hyped for its ability to interact in a human-like manner and even to pass university exams. But can ChatGPT pass the HSK?","breadcrumb":{"@id":"https:\/\/www.hackingchinese.com\/can-chatgpt-pass-the-hsk\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.hackingchinese.com\/can-chatgpt-pass-the-hsk\/"]}]},{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/www.hackingchinese.com\/can-chatgpt-pass-the-hsk\/#primaryimage","url":"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/robot-reading.jpeg","contentUrl":"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2023\/02\/robot-reading.jpeg","width":768,"height":768,"caption":"Robot reading. Created with Stable Diffusion and some GIMP editing for the book cover."},{"@type":"BreadcrumbList","@id":"https:\/\/www.hackingchinese.com\/can-chatgpt-pass-the-hsk\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.hackingchinese.com\/"},{"@type":"ListItem","position":2,"name":"Can ChatGPT pass the HSK?"}]},{"@type":"WebSite","@id":"https:\/\/www.hackingchinese.com\/#website","url":"https:\/\/www.hackingchinese.com\/","name":"Hacking Chinese","description":"A better way of learning Mandarin","publisher":{"@id":"https:\/\/www.hackingchinese.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.hackingchinese.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":"Organization","@id":"https:\/\/www.hackingchinese.com\/#organization","name":"Hacking Chinese","url":"https:\/\/www.hackingchinese.com\/","logo":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/www.hackingchinese.com\/#\/schema\/logo\/image\/","url":"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2010\/09\/square-stamp-1000.png","contentUrl":"https:\/\/www.hackingchinese.com\/wp-content\/uploads\/2010\/09\/square-stamp-1000.png","width":1000,"height":1000,"caption":"Hacking Chinese"},"image":{"@id":"https:\/\/www.hackingchinese.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/HackingChinese","https:\/\/x.com\/HackingChinese"]},{"@type":"Person","@id":"https:\/\/www.hackingchinese.com\/#\/schema\/person\/fd696a7384c7de665cc9d67c15205b15","name":"Olle Linge","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/secure.gravatar.com\/avatar\/7d60e40795941ec743c532d9ba9a94d261cd89f55ab4a7a0a8271040e7046559?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/7d60e40795941ec743c532d9ba9a94d261cd89f55ab4a7a0a8271040e7046559?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/7d60e40795941ec743c532d9ba9a94d261cd89f55ab4a7a0a8271040e7046559?s=96&d=mm&r=g","caption":"Olle Linge"},"description":"Hi! My name is Olle Linge (\u51cc\u96f2\u9f8d) and I'm the creator and editor of Hacking Chinese. Read more about the website and me on the About page.","sameAs":["http:\/\/www.hackingchinese.com"]}]}},"_links":{"self":[{"href":"https:\/\/www.hackingchinese.com\/wp-json\/wp\/v2\/posts\/16743","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.hackingchinese.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.hackingchinese.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.hackingchinese.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.hackingchinese.com\/wp-json\/wp\/v2\/comments?post=16743"}],"version-history":[{"count":16,"href":"https:\/\/www.hackingchinese.com\/wp-json\/wp\/v2\/posts\/16743\/revisions"}],"predecessor-version":[{"id":16786,"href":"https:\/\/www.hackingchinese.com\/wp-json\/wp\/v2\/posts\/16743\/revisions\/16786"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.hackingchinese.com\/wp-json\/wp\/v2\/media\/16767"}],"wp:attachment":[{"href":"https:\/\/www.hackingchinese.com\/wp-json\/wp\/v2\/media?parent=16743"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.hackingchinese.com\/wp-json\/wp\/v2\/categories?post=16743"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.hackingchinese.com\/wp-json\/wp\/v2\/tags?post=16743"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}