Preprint: https://arxiv.org/abs/2503.11704 # Author Notes **We suggest to use a Markdown Reader for the Markdown files (.md) with embedded code snippets.** Here in the wiki you will find a concise table of all generated tasks with associated concept and context(s). The translations were automatically generated by an LLM (gpt-4o-2024-08-06) and proofread by the authors. We did not re-evaluate the English version of the tasks for code execution and correctness. # Prompts @[osf](fjvdm) - All the prompts are available in English (translated) and German. Look for them under the *Files* tab in the *prompts* folder. - The workflow was implemented with <a href="https://langchain-ai.github.io/langgraphjs/" target="_blank">LangGraph.js</a>. - To test the model solution with the unit tests, we used our own open source code execution environment [Jury 1](https://github.com/hardebusch/jury1). # Generated Tasks We provide all generated tasks in JSON format: - [All 200 tasks in German (original)](https://osf.io/2hefm) - [All 200 tasks in English (translated)](https://osf.io/d6et7) You can find all the tasks in a more human-readable format in Markdown syntax in English (translated) or in German. Look under the *Files* tab in the *tasks* folder. ## One Programming Concept | ID | German (original) | English (translated) | Programming Concept | Context | |---|-------------|--------------|-------------------|---------| | 1 | Task 1 (DE) | Task 1 (EN) | For loops | Modern Gaming | | 2 | Task 2 (DE) | Task 2 (EN) | While loops | Film | | 3 | Task 3 (DE) | Task 3 (EN) | For Loops | Relationships | | 4 | Task 4 (DE) | Task 4 (EN) | String | Pets | | 5 | Task 5 (DE) | Task 5 (EN) | Recursion | Cooking | | 6 | Task 6 (DE) | Task 6 (EN) | If-Else statements | Animals | | 7 | Task 7 (DE) | Task 7 (EN) | If-Else statements | Basketball | | 8 | Task 8 (DE) | Task 8 (EN) | If-Else statements | Music | | 9 | Task 9 (DE) | Task 9 (EN) | Higher-order functions | Streaming Services | | 10 | Task 10 (DE) | Task 10 (EN) | Functions as Variables | Virtual Reality | | 11 | Task 11 (DE) | Task 11 (EN) | Recursion | Aquarium | | 12 | Task 12 (DE) | Task 12 (EN) | While loops | Sports | | 13 | Task 13 (DE) | Task 13 (EN) | Higher-order functions | Rugby | | 14 | Task 14 (DE) | Task 14 (EN) | Higher-order functions | Mental Health | | 15 | Task 15 (DE) | Task 15 (EN) | Lists | Pets | | 16 | Task 16 (DE) | Task 16 (EN) | If-Else statements | Animals | | 17 | Task 17 (DE) | Task 17 (EN) | Float | Modern Gaming | | 18 | Task 18 (DE) | Task 18 (EN) | Integer | Aquarium | | 19 | Task 19 (DE) | Task 19 (EN) | For loops | Amusement Park | | 20 | Task 20 (DE) | Task 20 (EN) | Tuples | Film | | 21 | Task 21 (DE) | Task 21 (EN) | Higher-order functions | Rugby | | 22 | Task 22 (DE) | Task 22 (EN) | Recursion | Virtual Reality | | 23 | Task 23 (DE) | Task 23 (EN) | Higher-order functions | Rugby | | 24 | Task 24 (DE) | Task 24 (EN) | Tuples | Fishing | | 25 | Task 25 (DE) | Task 25 (EN) | While loops | Gardening | | 26 | Task 26 (DE) | Task 26 (EN) | If-Else statements | Modern Gaming | | 27 | Task 27 (DE) | Task 27 (EN) | Logical operators (==, !=, <, >, <=, >=, or, and, not) | Fishing | | 28 | Task 28 (DE) | Task 28 (EN) | While loops | Social Media | | 29 | Task 29 (DE) | Task 29 (EN) | Recursion | Fishing | | 30 | Task 30 (DE) | Task 30 (EN) | Lists | Cooking | | 31 | Task 31 (DE) | Task 31 (EN) | Lists | Cooking | | 32 | Task 32 (DE) | Task 32 (EN) | Tuples | Amusement Park | | 33 | Task 33 (DE) | Task 33 (EN) | Tuples | Restaurant | | 34 | Task 34 (DE) | Task 34 (EN) | String | Sports | | 35 | Task 35 (DE) | Task 35 (EN) | If-Else statements; Logical operators (==, !=, <, >, <=, >=, or, and, not) | Olympics | | 36 | Task 36 (DE) | Task 36 (EN) | Functions as variables | Cooking | | 37 | Task 37 (DE) | Task 37 (EN) | Operations with numbers | Restaurant | | 38 | Task 38 (DE) | Task 38 (EN) | Logical operators (==, !=, <, >, <=, >=, or, and, not) | Cooking | | 39 | Task 39 (DE) | Task 39 (EN) | If-Else statements | Olympics | | 40 | Task 40 (DE) | Task 40 (EN) | If-Else statements | Social Media | | 41 | Task 41 (DE) | Task 41 (EN) | Recursion | Olympics | | 42 | Task 42 (DE) | Task 42 (EN) | Lists | Modern Gaming | | 43 | Task 43 (DE) | Task 43 (EN) | Float | Virtual Reality | | 44 | Task 44 (DE) | Task 44 (EN) | String | Relationships | | 45 | Task 45 (DE) | Task 45 (EN) | Higher-order functions | Cooking | | 46 | Task 46 (DE) | Task 46 (EN) | Integer | Film | | 47 | Task 47 (DE) | Task 47 (EN) | String | Fishing | | 48 | Task 48 (DE) | Task 48 (EN) | String | Cooking | | 49 | Task 49 (DE) | Task 49 (EN) | Operations with numbers | Restaurant | | 50 | Task 50 (DE) | Task 50 (EN) | Float | Animals | | 51 | Task 51 (DE) | Task 51 (EN) | String | Modern Gaming | | 52 | Task 52 (DE) | Task 52 (EN) | Operations with numbers | Basketball | | 53 | Task 53 (DE) | Task 53 (EN) | While loops | Basketball | | 54 | Task 54 (DE) | Task 54 (EN) | For loops | Modern Gaming | | 55 | Task 55 (DE) | Task 55 (EN) | Functions as variables | Sports | | 56 | Task 56 (DE) | Task 56 (EN) | Higher-order functions | Mental Health | | 57 | Task 57 (DE) | Task 57 (EN) | Tuple | Mental Health | | 58 | Task 58 (DE) | Task 58 (EN) | Integer | Social Media | | 59 | Task 59 (DE) | Task 59 (EN) | Recursion | Cooking | | 60 | Task 60 (DE) | Task 60 (EN) | Integer | Cooking | | 61 | Task 61 (DE) | Task 61 (EN) | Tuples | Gardening | | 62 | Task 62 (DE) | Task 62 (EN) | Lists | Fishing | | 63 | Task 63 (DE) | Task 63 (EN) | String | Social Media | | 64 | Task 64 (DE) | Task 64 (EN) | Tuples | Basketball | | 65 | Task 65 (DE) | Task 65 (EN) | Recursion | Rugby | | 66 | Task 66 (DE) | Task 66 (EN) | Functions as variables | Mental Health | | 67 | Task 67 (DE) | Task 67 (EN) | Boolean and None | Sports | | 68 | Task 68 (DE) | Task 68 (EN) | Recursion | Music | | 69 | Task 69 (DE) | Task 69 (EN) | Float | Music | | 70 | Task 70 (DE) | Task 70 (EN) | Logical operators (==, !=, <, >, <=, >=, or, and, not) | Fishing | | 71 | Task 71 (DE) | Task 71 (EN) | Integer | Streaming Services | | 72 | Task 72 (DE) | Task 72 (EN) | Integer | Modern Gaming | | 73 | Task 73 (DE) | Task 73 (EN) | Recursion | Virtual Reality | | 74 | Task 74 (DE) | Task 74 (EN) | Higher-order functions | Rugby | | 75 | Task 75 (DE) | Task 75 (EN) | Integer | Pets | | 76 | Task 76 (DE) | Task 76 (EN) | For loops | Basketball | | 77 | Task 77 (DE) | Task 77 (EN) | Boolean and None | Aquarium | | 78 | Task 78 (DE) | Task 78 (EN) | Functions as variables | Pets | | 79 | Task 79 (DE) | Task 79 (EN) | Higher-order functions | Mental Health | | 80 | Task 80 (DE) | Task 80 (EN) | Recursion | Pets | | 81 | Task 81 (DE) | Task 81 (EN) | Tuples | Gardening | | 82 | Task 82 (DE) | Task 82 (EN) | Integer | Animals | | 83 | Task 83 (DE) | Task 83 (EN) | Float | Mental Health | | 84 | Task 84 (DE) | Task 84 (EN) | Lists | Fishing | | 85 | Task 85 (DE) | Task 85 (EN) | Integer | Aquarium | | 86 | Task 86 (DE) | Task 86 (EN) | While loops | Fishing | | 87 | Task 87 (DE) | Task 87 (EN) | Recursion | Fishing | | 88 | Task 88 (DE) | Task 88 (EN) | Integer | Sports | | 89 | Task 89 (DE) | Task 89 (EN) | For loops | Restaurant | | 90 | Task 90 (DE) | Task 90 (EN) | For loops | Fishing | | 91 | Task 91 (DE) | Task 91 (EN) | While loops | Aquarium | | 92 | Task 92 (DE) | Task 92 (EN) | Operations with numbers | Aquarium | | 93 | Task 93 (DE) | Task 93 (EN) | Lists | Cooking | | 94 | Task 94 (DE) | Task 94 (EN) | Float | Rugby | | 95 | Task 95 (DE) | Task 95 (EN) | Higher-order functions | Gardening | | 96 | Task 96 (DE) | Task 96 (EN) | Higher-order functions | Sports | | 97 | Task 97 (DE) | Task 97 (EN) | Boolean and None | Pets | | 98 | Task 98 (DE) | Task 98 (EN) | Float | Cooking | | 99 | Task 99 (DE) | Task 99 (EN) | If-Else statements | Animals | | 100 | Task 100 (DE) | Task 100 (EN) | Recursion | Animals | ## Two Programming Concepts | ID | German (original) | English (translated) | Programming Concept | Context | |---|-------------|--------------|-------------------|---------| | 101 | Task 101 (DE) | Task 101 (EN) | Recursion;If-Else statements | Fishing | | 102 | Task 102 (DE) | Task 102 (EN) | Operations with numbers; For loops | Sports | | 103 | Task 103 (DE) | Task 103 (EN) | Boolean and None; Float | Animals | | 104 | Task 104 (DE) | Task 104 (EN) | Functions as variables; Integer | Animals | | 105 | Task 105 (DE) | Task 105 (EN) | Logical operators (==, !=, <, >, <=, >=, or, and, not);While loops | Modern Gaming | | 106 | Task 106 (DE) | Task 106 (EN) | Float;Tuple | Pets | | 107 | Task 107 (DE) | Task 107 (EN) | If-Else statements; Logical operators (==, !=, <, >, <=, >=, or, and, not) | Basketball | | 108 | Task 108 (DE) | Task 108 (EN) | Lists; Recursion | Amusement Park | | 109 | Task 109 (DE) | Task 109 (EN) | Functions as variables; Operations with numbers | Fishing | | 110 | Task 110 (DE) | Task 110 (EN) | Boolean and None; Logical operators (==, !=, <, >, <=, >=, or, and, not) | Social Media | | 111 | Task 111 (DE) | Task 111 (EN) | Boolean and None; Float | Sports | | 112 | Task 112 (DE) | Task 112 (EN) | Tuples; Functions as variables | Mental Health | | 113 | Task 113 (DE) | Task 113 (EN) | Float;While loops | Amusement Park | | 114 | Task 114 (DE) | Task 114 (EN) | While loops; Higher-order functions | Cooking | | 115 | Task 115 (DE) | Task 115 (EN) | Operations with numbers;Integer | Modern Gaming | | 116 | Task 116 (DE) | Task 116 (EN) | If-Else statements;Operations with numbers | Modern Gaming | | 117 | Task 117 (DE) | Task 117 (EN) | Boolean and None; Higher-order functions | Social Media | | 118 | Task 118 (DE) | Task 118 (EN) | Lists;Float | Olympics | | 119 | Task 119 (DE) | Task 119 (EN) | While loops;Boolean and None | Streaming Services | | 120 | Task 120 (DE) | Task 120 (EN) | String; Lists | Film | | 121 | Task 121 (DE) | Task 121 (EN) | Lists;If-Else statements | Rugby | | 122 | Task 122 (DE) | Task 122 (EN) | For loops; While loops | Amusement Park | | 123 | Task 123 (DE) | Task 123 (EN) | While loops;If-Else statements | Music | | 124 | Task 124 (DE) | Task 124 (EN) | Functions as variables; Logical operators (==, !=, <, >, <=, >=, or, and, not) | Aquarium | | 125 | Task 125 (DE) | Task 125 (EN) | If-Else statements; For loops | Cooking | | 126 | Task 126 (DE) | Task 126 (EN) | Float; Lists | Animals | | 127 | Task 127 (DE) | Task 127 (EN) | Tuples;Integer | Restaurant | | 128 | Task 128 (DE) | Task 128 (EN) | Boolean and None; For loops | Fishing | | 129 | Task 129 (DE) | Task 129 (EN) | Boolean and None;For loops | Animals | | 130 | Task 130 (DE) | Task 130 (EN) | If-Else statements; String | Amusement Park | | 131 | Task 131 (DE) | Task 131 (EN) | For loops; If-Else statements | Restaurant | | 132 | Task 132 (DE) | Task 132 (EN) | Recursion; Functions as variables | Basketball | | 133 | Task 133 (DE) | Task 133 (EN) | Recursion;For loops | Basketball | | 134 | Task 134 (DE) | Task 134 (EN) | Functions as variables; Boolean and None | Pets | | 135 | Task 135 (DE) | Task 135 (EN) | Lists;String | Streaming Services | | 136 | Task 136 (DE) | Task 136 (EN) | String; Integer | Relationships | | 137 | Task 137 (DE) | Task 137 (EN) | While loops; Boolean and None | Basketball | | 138 | Task 138 (DE) | Task 138 (EN) | Boolean and None; String | Relationships | | 139 | Task 139 (DE) | Task 139 (EN) | Logical operators (==, !=, <, >, <=, >=, or, and, not); While loops | Relationships | | 140 | Task 140 (DE) | Task 140 (EN) | Higher-order functions; String | Virtual Reality | | 141 | Task 141 (DE) | Task 141 (EN) | String; Logical operators (==, !=, <, >, <=, >=, or, and, not) | Basketball | | 142 | Task 142 (DE) | Task 142 (EN) | While loops; If-Else statements | Film | | 143 | Task 143 (DE) | Task 143 (EN) | Lists; Recursion | Social Media | | 144 | Task 144 (DE) | Task 144 (EN) | Float; While loops | Music | | 145 | Task 145 (DE) | Task 145 (EN) | Functions as variables; If-Else statements | Relationships | | 146 | Task 146 (DE) | Task 146 (EN) | Lists;Tuples | Gardening | | 147 | Task 147 (DE) | Task 147 (EN) | Tuples;For loops | Animals | | 148 | Task 148 (DE) | Task 148 (EN) | String;Integer | Mental Health | | 149 | Task 149 (DE) | Task 149 (EN) | String;Operations with numbers | Olympics | | 150 | Task 150 (DE) | Task 150 (EN) | Boolean and None;Recursion | Film | ## Three Programming Concepts | ID | German (original) | English (translated) | Programming Concept | Context | |---|-------------|--------------|-------------------|---------| | 151 | Task 151 (DE) | Task 151 (EN) | String; Integer; Logical operators (==, !=, <, >, <=, >=, or, and, not) | Fishing | | 152 | Task 152 (DE) | Task 152 (EN) | Operations with numbers; String; Float | Olympics | | 153 | Task 153 (DE) | Task 153 (EN) | For loops;If-Else statements;Operations with numbers | Pets | | 154 | Task 154 (DE) | Task 154 (EN) | If-Else statements; Functions as variables; Boolean and None | Sports | | 155 | Task 155 (DE) | Task 155 (EN) | Boolean and None;Operations with numbers;If-Else statements | Relationships | | 156 | Task 156 (DE) | Task 156 (EN) | If-Else statements; Higher-order functions; String | Rugby | | 157 | Task 157 (DE) | Task 157 (EN) | Functions as variables; Logical operators (==, !=, <, >, <=, >=, or, and, not); Lists | Virtual Reality | | 158 | Task 158 (DE) | Task 158 (EN) | Operations with numbers;String;Boolean and None | Olympics | | 159 | Task 159 (DE) | Task 159 (EN) | If-Else statements; Float; While loops | Social Media | | 160 | Task 160 (DE) | Task 160 (EN) | While loops; Recursion; Operations with numbers | Olympics | | 161 | Task 161 (DE) | Task 161 (EN) | Functions as variables;Integer;Recursion | Mental Health | | 162 | Task 162 (DE) | Task 162 (EN) | Higher-order functions; Control structures (==, !=, <, >, <=, >=, or, and, not); Operations with numbers | Sports | | 163 | Task 163 (DE) | Task 163 (EN) | Integer; String; Boolean and None | Pets | | 164 | Task 164 (DE) | Task 164 (EN) | Tuples; Float; Higher-order functions | Gardening | | 165 | Task 165 (DE) | Task 165 (EN) | Boolean and None; Logical operators (==, !=, <, >, <=, >=, or, and, not); Float | Relationships | | 166 | Task 166 (DE) | Task 166 (EN) | Integer;For loops;Higher-order functions | Streaming Services | | 167 | Task 167 (DE) | Task 167 (EN) | Functions as variables;Recursion;Tuples | Cooking | | 168 | Task 168 (DE) | Task 168 (EN) | Logical operators (==, !=, <, >, <=, >=, or, and, not); Recursion; For loops | Streaming Services | | 169 | Task 169 (DE) | Task 169 (EN) | Integer;For loops;Higher-order functions | Music | | 170 | Task 170 (DE) | Task 170 (EN) | Lists;While loops;Functions as variables | Streaming Services | | 171 | Task 171 (DE) | Task 171 (EN) | If-Else statements;For loops;Tuples | Basketball | | 172 | Task 172 (DE) | Task 172 (EN) | Float;Higher-order functions;Integer | Animals | | 173 | Task 173 (DE) | Task 173 (EN) | Operations with numbers; Tuples; For loops | Sports | | 174 | Task 174 (DE) | Task 174 (EN) | Functions as variables; Float; For loops | Mental Health | | 175 | Task 175 (DE) | Task 175 (EN) | Functions as variables; If-Else statements; Lists | Pets | | 176 | Task 176 (DE) | Task 176 (EN) | If-Else statements;Tuples;Float | Rugby | | 177 | Task 177 (DE) | Task 177 (EN) | String; Functions as variables; Lists | Streaming Services | | 178 | Task 178 (DE) | Task 178 (EN) | Boolean and None;For loops;Operations with numbers | Virtual Reality | | 179 | Task 179 (DE) | Task 179 (EN) | For loops;While loops;If-Else statements | Fishing | | 180 | Task 180 (DE) | Task 180 (EN) | Tuples;Operations with numbers;Control structures (==, !=, <, >, <=, >=, or, and, not) | Music | | 181 | Task 181 (DE) | Task 181 (EN) | For loops; Recursion; Operations with numbers | Sports | | 182 | Task 182 (DE) | Task 182 (EN) | String; Lists; Functions as variables | Mental Health | | 183 | Task 183 (DE) | Task 183 (EN) | Tuples;Integer;Logical operators (==, !=, <, >, <=, >=, or, and, not) | Pets | | 184 | Task 184 (DE) | Task 184 (EN) | String;Integer;For loops | Fishing | | 185 | Task 185 (DE) | Task 185 (EN) | Recursion;Float;Integer | Olympics | | 186 | Task 186 (DE) | Task 186 (EN) | If-Else statements; While loops; Boolean and None | Modern Gaming | | 187 | Task 187 (DE) | Task 187 (EN) | Recursion;Higher-order functions;Operations with numbers | Fishing | | 188 | Task 188 (DE) | Task 188 (EN) | Integer; Logical operators (==, !=, <, >, <=, >=, or, and, not); Lists | Basketball | | 189 | Task 189 (DE) | Task 189 (EN) | Float;Operations with numbers;Control structures (==, !=, <, >, <=, >=, or, and, not) | Pets | | 190 | Task 190 (DE) | Task 190 (EN) | Integer;Lists;String | Rugby | | 191 | Task 191 (DE) | Task 191 (EN) | If-Else statements; Recursion; Boolean and None | Rugby | | 192 | Task 192 (DE) | Task 192 (EN) | Logical operators (==, !=, <, >, <=, >=, or, and, not);For loops;Tuples | Rugby | | 193 | Task 193 (DE) | Task 193 (EN) | For loops; Control structures (==, !=, <, >, <=, >=, or, and, not); If-Else statements | Cooking | | 194 | Task 194 (DE) | Task 194 (EN) | Boolean and None;String;Operations with numbers | Sports | | 195 | Task 195 (DE) | Task 195 (EN) | If-Else statements;Boolean and None;Functions as variables | Restaurant | | 196 | Task 196 (DE) | Task 196 (EN) | Operations with numbers;Recursion;Float | Rugby | | 197 | Task 197 (DE) | Task 197 (EN) | Float;If-Else statements;Higher-order functions | Social Media | | 198 | Task 198 (DE) | Task 198 (EN) | Logical operators (==, !=, <, >, <=, >=, or, and, not); Tuples; For loops | Mental Health | | 199 | Task 199 (DE) | Task 199 (EN) | While loops;String;Tuple | Film | | 200 | Task 200 (DE) | Task 200 (EN) | Lists; Operations with numbers; If-Else statements | Relationships |