Preprint: https://arxiv.org/abs/2503.11704
# Author Notes
**We suggest to use a Markdown Reader for the Markdown files (.md) with embedded code snippets.**
Here in the wiki you will find a concise table of all generated tasks with associated concept and context(s). The translations were automatically generated by an LLM (gpt-4o-2024-08-06) and proofread by the authors. We did not re-evaluate the English version of the tasks for code execution and correctness.
# Prompts
@[osf](fjvdm)
- All the prompts are available in English (translated) and German. Look for them under the *Files* tab in the *prompts* folder.
- The workflow was implemented with <a href="https://langchain-ai.github.io/langgraphjs/" target="_blank">LangGraph.js</a>.
- To test the model solution with the unit tests, we used our own open source code execution environment [Jury 1](https://github.com/hardebusch/jury1).
# Generated Tasks
We provide all generated tasks in JSON format:
- [All 200 tasks in German (original)](https://osf.io/2hefm)
- [All 200 tasks in English (translated)](https://osf.io/d6et7)
You can find all the tasks in a more human-readable format in Markdown syntax in English (translated) or in German. Look under the *Files* tab in the *tasks* folder.
## One Programming Concept
| ID | German (original) | English (translated) | Programming Concept | Context |
|---|-------------|--------------|-------------------|---------|
| 1 | Task 1 (DE) | Task 1 (EN) | For loops | Modern Gaming |
| 2 | Task 2 (DE) | Task 2 (EN) | While loops | Film |
| 3 | Task 3 (DE) | Task 3 (EN) | For Loops | Relationships |
| 4 | Task 4 (DE) | Task 4 (EN) | String | Pets |
| 5 | Task 5 (DE) | Task 5 (EN) | Recursion | Cooking |
| 6 | Task 6 (DE) | Task 6 (EN) | If-Else statements | Animals |
| 7 | Task 7 (DE) | Task 7 (EN) | If-Else statements | Basketball |
| 8 | Task 8 (DE) | Task 8 (EN) | If-Else statements | Music |
| 9 | Task 9 (DE) | Task 9 (EN) | Higher-order functions | Streaming Services |
| 10 | Task 10 (DE) | Task 10 (EN) | Functions as Variables | Virtual Reality |
| 11 | Task 11 (DE) | Task 11 (EN) | Recursion | Aquarium |
| 12 | Task 12 (DE) | Task 12 (EN) | While loops | Sports |
| 13 | Task 13 (DE) | Task 13 (EN) | Higher-order functions | Rugby |
| 14 | Task 14 (DE) | Task 14 (EN) | Higher-order functions | Mental Health |
| 15 | Task 15 (DE) | Task 15 (EN) | Lists | Pets |
| 16 | Task 16 (DE) | Task 16 (EN) | If-Else statements | Animals |
| 17 | Task 17 (DE) | Task 17 (EN) | Float | Modern Gaming |
| 18 | Task 18 (DE) | Task 18 (EN) | Integer | Aquarium |
| 19 | Task 19 (DE) | Task 19 (EN) | For loops | Amusement Park |
| 20 | Task 20 (DE) | Task 20 (EN) | Tuples | Film |
| 21 | Task 21 (DE) | Task 21 (EN) | Higher-order functions | Rugby |
| 22 | Task 22 (DE) | Task 22 (EN) | Recursion | Virtual Reality |
| 23 | Task 23 (DE) | Task 23 (EN) | Higher-order functions | Rugby |
| 24 | Task 24 (DE) | Task 24 (EN) | Tuples | Fishing |
| 25 | Task 25 (DE) | Task 25 (EN) | While loops | Gardening |
| 26 | Task 26 (DE) | Task 26 (EN) | If-Else statements | Modern Gaming |
| 27 | Task 27 (DE) | Task 27 (EN) | Logical operators (==, !=, <, >, <=, >=, or, and, not) | Fishing |
| 28 | Task 28 (DE) | Task 28 (EN) | While loops | Social Media |
| 29 | Task 29 (DE) | Task 29 (EN) | Recursion | Fishing |
| 30 | Task 30 (DE) | Task 30 (EN) | Lists | Cooking |
| 31 | Task 31 (DE) | Task 31 (EN) | Lists | Cooking |
| 32 | Task 32 (DE) | Task 32 (EN) | Tuples | Amusement Park |
| 33 | Task 33 (DE) | Task 33 (EN) | Tuples | Restaurant |
| 34 | Task 34 (DE) | Task 34 (EN) | String | Sports |
| 35 | Task 35 (DE) | Task 35 (EN) | If-Else statements; Logical operators (==, !=, <, >, <=, >=, or, and, not) | Olympics |
| 36 | Task 36 (DE) | Task 36 (EN) | Functions as variables | Cooking |
| 37 | Task 37 (DE) | Task 37 (EN) | Operations with numbers | Restaurant |
| 38 | Task 38 (DE) | Task 38 (EN) | Logical operators (==, !=, <, >, <=, >=, or, and, not) | Cooking |
| 39 | Task 39 (DE) | Task 39 (EN) | If-Else statements | Olympics |
| 40 | Task 40 (DE) | Task 40 (EN) | If-Else statements | Social Media |
| 41 | Task 41 (DE) | Task 41 (EN) | Recursion | Olympics |
| 42 | Task 42 (DE) | Task 42 (EN) | Lists | Modern Gaming |
| 43 | Task 43 (DE) | Task 43 (EN) | Float | Virtual Reality |
| 44 | Task 44 (DE) | Task 44 (EN) | String | Relationships |
| 45 | Task 45 (DE) | Task 45 (EN) | Higher-order functions | Cooking |
| 46 | Task 46 (DE) | Task 46 (EN) | Integer | Film |
| 47 | Task 47 (DE) | Task 47 (EN) | String | Fishing |
| 48 | Task 48 (DE) | Task 48 (EN) | String | Cooking |
| 49 | Task 49 (DE) | Task 49 (EN) | Operations with numbers | Restaurant |
| 50 | Task 50 (DE) | Task 50 (EN) | Float | Animals |
| 51 | Task 51 (DE) | Task 51 (EN) | String | Modern Gaming |
| 52 | Task 52 (DE) | Task 52 (EN) | Operations with numbers | Basketball |
| 53 | Task 53 (DE) | Task 53 (EN) | While loops | Basketball |
| 54 | Task 54 (DE) | Task 54 (EN) | For loops | Modern Gaming |
| 55 | Task 55 (DE) | Task 55 (EN) | Functions as variables | Sports |
| 56 | Task 56 (DE) | Task 56 (EN) | Higher-order functions | Mental Health |
| 57 | Task 57 (DE) | Task 57 (EN) | Tuple | Mental Health |
| 58 | Task 58 (DE) | Task 58 (EN) | Integer | Social Media |
| 59 | Task 59 (DE) | Task 59 (EN) | Recursion | Cooking |
| 60 | Task 60 (DE) | Task 60 (EN) | Integer | Cooking |
| 61 | Task 61 (DE) | Task 61 (EN) | Tuples | Gardening |
| 62 | Task 62 (DE) | Task 62 (EN) | Lists | Fishing |
| 63 | Task 63 (DE) | Task 63 (EN) | String | Social Media |
| 64 | Task 64 (DE) | Task 64 (EN) | Tuples | Basketball |
| 65 | Task 65 (DE) | Task 65 (EN) | Recursion | Rugby |
| 66 | Task 66 (DE) | Task 66 (EN) | Functions as variables | Mental Health |
| 67 | Task 67 (DE) | Task 67 (EN) | Boolean and None | Sports |
| 68 | Task 68 (DE) | Task 68 (EN) | Recursion | Music |
| 69 | Task 69 (DE) | Task 69 (EN) | Float | Music |
| 70 | Task 70 (DE) | Task 70 (EN) | Logical operators (==, !=, <, >, <=, >=, or, and, not) | Fishing |
| 71 | Task 71 (DE) | Task 71 (EN) | Integer | Streaming Services |
| 72 | Task 72 (DE) | Task 72 (EN) | Integer | Modern Gaming |
| 73 | Task 73 (DE) | Task 73 (EN) | Recursion | Virtual Reality |
| 74 | Task 74 (DE) | Task 74 (EN) | Higher-order functions | Rugby |
| 75 | Task 75 (DE) | Task 75 (EN) | Integer | Pets |
| 76 | Task 76 (DE) | Task 76 (EN) | For loops | Basketball |
| 77 | Task 77 (DE) | Task 77 (EN) | Boolean and None | Aquarium |
| 78 | Task 78 (DE) | Task 78 (EN) | Functions as variables | Pets |
| 79 | Task 79 (DE) | Task 79 (EN) | Higher-order functions | Mental Health |
| 80 | Task 80 (DE) | Task 80 (EN) | Recursion | Pets |
| 81 | Task 81 (DE) | Task 81 (EN) | Tuples | Gardening |
| 82 | Task 82 (DE) | Task 82 (EN) | Integer | Animals |
| 83 | Task 83 (DE) | Task 83 (EN) | Float | Mental Health |
| 84 | Task 84 (DE) | Task 84 (EN) | Lists | Fishing |
| 85 | Task 85 (DE) | Task 85 (EN) | Integer | Aquarium |
| 86 | Task 86 (DE) | Task 86 (EN) | While loops | Fishing |
| 87 | Task 87 (DE) | Task 87 (EN) | Recursion | Fishing |
| 88 | Task 88 (DE) | Task 88 (EN) | Integer | Sports |
| 89 | Task 89 (DE) | Task 89 (EN) | For loops | Restaurant |
| 90 | Task 90 (DE) | Task 90 (EN) | For loops | Fishing |
| 91 | Task 91 (DE) | Task 91 (EN) | While loops | Aquarium |
| 92 | Task 92 (DE) | Task 92 (EN) | Operations with numbers | Aquarium |
| 93 | Task 93 (DE) | Task 93 (EN) | Lists | Cooking |
| 94 | Task 94 (DE) | Task 94 (EN) | Float | Rugby |
| 95 | Task 95 (DE) | Task 95 (EN) | Higher-order functions | Gardening |
| 96 | Task 96 (DE) | Task 96 (EN) | Higher-order functions | Sports |
| 97 | Task 97 (DE) | Task 97 (EN) | Boolean and None | Pets |
| 98 | Task 98 (DE) | Task 98 (EN) | Float | Cooking |
| 99 | Task 99 (DE) | Task 99 (EN) | If-Else statements | Animals |
| 100 | Task 100 (DE) | Task 100 (EN) | Recursion | Animals |
## Two Programming Concepts
| ID | German (original) | English (translated) | Programming Concept | Context |
|---|-------------|--------------|-------------------|---------|
| 101 | Task 101 (DE) | Task 101 (EN) | Recursion;If-Else statements | Fishing |
| 102 | Task 102 (DE) | Task 102 (EN) | Operations with numbers; For loops | Sports |
| 103 | Task 103 (DE) | Task 103 (EN) | Boolean and None; Float | Animals |
| 104 | Task 104 (DE) | Task 104 (EN) | Functions as variables; Integer | Animals |
| 105 | Task 105 (DE) | Task 105 (EN) | Logical operators (==, !=, <, >, <=, >=, or, and, not);While loops | Modern Gaming |
| 106 | Task 106 (DE) | Task 106 (EN) | Float;Tuple | Pets |
| 107 | Task 107 (DE) | Task 107 (EN) | If-Else statements; Logical operators (==, !=, <, >, <=, >=, or, and, not) | Basketball |
| 108 | Task 108 (DE) | Task 108 (EN) | Lists; Recursion | Amusement Park |
| 109 | Task 109 (DE) | Task 109 (EN) | Functions as variables; Operations with numbers | Fishing |
| 110 | Task 110 (DE) | Task 110 (EN) | Boolean and None; Logical operators (==, !=, <, >, <=, >=, or, and, not) | Social Media |
| 111 | Task 111 (DE) | Task 111 (EN) | Boolean and None; Float | Sports |
| 112 | Task 112 (DE) | Task 112 (EN) | Tuples; Functions as variables | Mental Health |
| 113 | Task 113 (DE) | Task 113 (EN) | Float;While loops | Amusement Park |
| 114 | Task 114 (DE) | Task 114 (EN) | While loops; Higher-order functions | Cooking |
| 115 | Task 115 (DE) | Task 115 (EN) | Operations with numbers;Integer | Modern Gaming |
| 116 | Task 116 (DE) | Task 116 (EN) | If-Else statements;Operations with numbers | Modern Gaming |
| 117 | Task 117 (DE) | Task 117 (EN) | Boolean and None; Higher-order functions | Social Media |
| 118 | Task 118 (DE) | Task 118 (EN) | Lists;Float | Olympics |
| 119 | Task 119 (DE) | Task 119 (EN) | While loops;Boolean and None | Streaming Services |
| 120 | Task 120 (DE) | Task 120 (EN) | String; Lists | Film |
| 121 | Task 121 (DE) | Task 121 (EN) | Lists;If-Else statements | Rugby |
| 122 | Task 122 (DE) | Task 122 (EN) | For loops; While loops | Amusement Park |
| 123 | Task 123 (DE) | Task 123 (EN) | While loops;If-Else statements | Music |
| 124 | Task 124 (DE) | Task 124 (EN) | Functions as variables; Logical operators (==, !=, <, >, <=, >=, or, and, not) | Aquarium |
| 125 | Task 125 (DE) | Task 125 (EN) | If-Else statements; For loops | Cooking |
| 126 | Task 126 (DE) | Task 126 (EN) | Float; Lists | Animals |
| 127 | Task 127 (DE) | Task 127 (EN) | Tuples;Integer | Restaurant |
| 128 | Task 128 (DE) | Task 128 (EN) | Boolean and None; For loops | Fishing |
| 129 | Task 129 (DE) | Task 129 (EN) | Boolean and None;For loops | Animals |
| 130 | Task 130 (DE) | Task 130 (EN) | If-Else statements; String | Amusement Park |
| 131 | Task 131 (DE) | Task 131 (EN) | For loops; If-Else statements | Restaurant |
| 132 | Task 132 (DE) | Task 132 (EN) | Recursion; Functions as variables | Basketball |
| 133 | Task 133 (DE) | Task 133 (EN) | Recursion;For loops | Basketball |
| 134 | Task 134 (DE) | Task 134 (EN) | Functions as variables; Boolean and None | Pets |
| 135 | Task 135 (DE) | Task 135 (EN) | Lists;String | Streaming Services |
| 136 | Task 136 (DE) | Task 136 (EN) | String; Integer | Relationships |
| 137 | Task 137 (DE) | Task 137 (EN) | While loops; Boolean and None | Basketball |
| 138 | Task 138 (DE) | Task 138 (EN) | Boolean and None; String | Relationships |
| 139 | Task 139 (DE) | Task 139 (EN) | Logical operators (==, !=, <, >, <=, >=, or, and, not); While loops | Relationships |
| 140 | Task 140 (DE) | Task 140 (EN) | Higher-order functions; String | Virtual Reality |
| 141 | Task 141 (DE) | Task 141 (EN) | String; Logical operators (==, !=, <, >, <=, >=, or, and, not) | Basketball |
| 142 | Task 142 (DE) | Task 142 (EN) | While loops; If-Else statements | Film |
| 143 | Task 143 (DE) | Task 143 (EN) | Lists; Recursion | Social Media |
| 144 | Task 144 (DE) | Task 144 (EN) | Float; While loops | Music |
| 145 | Task 145 (DE) | Task 145 (EN) | Functions as variables; If-Else statements | Relationships |
| 146 | Task 146 (DE) | Task 146 (EN) | Lists;Tuples | Gardening |
| 147 | Task 147 (DE) | Task 147 (EN) | Tuples;For loops | Animals |
| 148 | Task 148 (DE) | Task 148 (EN) | String;Integer | Mental Health |
| 149 | Task 149 (DE) | Task 149 (EN) | String;Operations with numbers | Olympics |
| 150 | Task 150 (DE) | Task 150 (EN) | Boolean and None;Recursion | Film |
## Three Programming Concepts
| ID | German (original) | English (translated) | Programming Concept | Context |
|---|-------------|--------------|-------------------|---------|
| 151 | Task 151 (DE) | Task 151 (EN) | String; Integer; Logical operators (==, !=, <, >, <=, >=, or, and, not) | Fishing |
| 152 | Task 152 (DE) | Task 152 (EN) | Operations with numbers; String; Float | Olympics |
| 153 | Task 153 (DE) | Task 153 (EN) | For loops;If-Else statements;Operations with numbers | Pets |
| 154 | Task 154 (DE) | Task 154 (EN) | If-Else statements; Functions as variables; Boolean and None | Sports |
| 155 | Task 155 (DE) | Task 155 (EN) | Boolean and None;Operations with numbers;If-Else statements | Relationships |
| 156 | Task 156 (DE) | Task 156 (EN) | If-Else statements; Higher-order functions; String | Rugby |
| 157 | Task 157 (DE) | Task 157 (EN) | Functions as variables; Logical operators (==, !=, <, >, <=, >=, or, and, not); Lists | Virtual Reality |
| 158 | Task 158 (DE) | Task 158 (EN) | Operations with numbers;String;Boolean and None | Olympics |
| 159 | Task 159 (DE) | Task 159 (EN) | If-Else statements; Float; While loops | Social Media |
| 160 | Task 160 (DE) | Task 160 (EN) | While loops; Recursion; Operations with numbers | Olympics |
| 161 | Task 161 (DE) | Task 161 (EN) | Functions as variables;Integer;Recursion | Mental Health |
| 162 | Task 162 (DE) | Task 162 (EN) | Higher-order functions; Control structures (==, !=, <, >, <=, >=, or, and, not); Operations with numbers | Sports |
| 163 | Task 163 (DE) | Task 163 (EN) | Integer; String; Boolean and None | Pets |
| 164 | Task 164 (DE) | Task 164 (EN) | Tuples; Float; Higher-order functions | Gardening |
| 165 | Task 165 (DE) | Task 165 (EN) | Boolean and None; Logical operators (==, !=, <, >, <=, >=, or, and, not); Float | Relationships |
| 166 | Task 166 (DE) | Task 166 (EN) | Integer;For loops;Higher-order functions | Streaming Services |
| 167 | Task 167 (DE) | Task 167 (EN) | Functions as variables;Recursion;Tuples | Cooking |
| 168 | Task 168 (DE) | Task 168 (EN) | Logical operators (==, !=, <, >, <=, >=, or, and, not); Recursion; For loops | Streaming Services |
| 169 | Task 169 (DE) | Task 169 (EN) | Integer;For loops;Higher-order functions | Music |
| 170 | Task 170 (DE) | Task 170 (EN) | Lists;While loops;Functions as variables | Streaming Services |
| 171 | Task 171 (DE) | Task 171 (EN) | If-Else statements;For loops;Tuples | Basketball |
| 172 | Task 172 (DE) | Task 172 (EN) | Float;Higher-order functions;Integer | Animals |
| 173 | Task 173 (DE) | Task 173 (EN) | Operations with numbers; Tuples; For loops | Sports |
| 174 | Task 174 (DE) | Task 174 (EN) | Functions as variables; Float; For loops | Mental Health |
| 175 | Task 175 (DE) | Task 175 (EN) | Functions as variables; If-Else statements; Lists | Pets |
| 176 | Task 176 (DE) | Task 176 (EN) | If-Else statements;Tuples;Float | Rugby |
| 177 | Task 177 (DE) | Task 177 (EN) | String; Functions as variables; Lists | Streaming Services |
| 178 | Task 178 (DE) | Task 178 (EN) | Boolean and None;For loops;Operations with numbers | Virtual Reality |
| 179 | Task 179 (DE) | Task 179 (EN) | For loops;While loops;If-Else statements | Fishing |
| 180 | Task 180 (DE) | Task 180 (EN) | Tuples;Operations with numbers;Control structures (==, !=, <, >, <=, >=, or, and, not) | Music |
| 181 | Task 181 (DE) | Task 181 (EN) | For loops; Recursion; Operations with numbers | Sports |
| 182 | Task 182 (DE) | Task 182 (EN) | String; Lists; Functions as variables | Mental Health |
| 183 | Task 183 (DE) | Task 183 (EN) | Tuples;Integer;Logical operators (==, !=, <, >, <=, >=, or, and, not) | Pets |
| 184 | Task 184 (DE) | Task 184 (EN) | String;Integer;For loops | Fishing |
| 185 | Task 185 (DE) | Task 185 (EN) | Recursion;Float;Integer | Olympics |
| 186 | Task 186 (DE) | Task 186 (EN) | If-Else statements; While loops; Boolean and None | Modern Gaming |
| 187 | Task 187 (DE) | Task 187 (EN) | Recursion;Higher-order functions;Operations with numbers | Fishing |
| 188 | Task 188 (DE) | Task 188 (EN) | Integer; Logical operators (==, !=, <, >, <=, >=, or, and, not); Lists | Basketball |
| 189 | Task 189 (DE) | Task 189 (EN) | Float;Operations with numbers;Control structures (==, !=, <, >, <=, >=, or, and, not) | Pets |
| 190 | Task 190 (DE) | Task 190 (EN) | Integer;Lists;String | Rugby |
| 191 | Task 191 (DE) | Task 191 (EN) | If-Else statements; Recursion; Boolean and None | Rugby |
| 192 | Task 192 (DE) | Task 192 (EN) | Logical operators (==, !=, <, >, <=, >=, or, and, not);For loops;Tuples | Rugby |
| 193 | Task 193 (DE) | Task 193 (EN) | For loops; Control structures (==, !=, <, >, <=, >=, or, and, not); If-Else statements | Cooking |
| 194 | Task 194 (DE) | Task 194 (EN) | Boolean and None;String;Operations with numbers | Sports |
| 195 | Task 195 (DE) | Task 195 (EN) | If-Else statements;Boolean and None;Functions as variables | Restaurant |
| 196 | Task 196 (DE) | Task 196 (EN) | Operations with numbers;Recursion;Float | Rugby |
| 197 | Task 197 (DE) | Task 197 (EN) | Float;If-Else statements;Higher-order functions | Social Media |
| 198 | Task 198 (DE) | Task 198 (EN) | Logical operators (==, !=, <, >, <=, >=, or, and, not); Tuples; For loops | Mental Health |
| 199 | Task 199 (DE) | Task 199 (EN) | While loops;String;Tuple | Film |
| 200 | Task 200 (DE) | Task 200 (EN) | Lists; Operations with numbers; If-Else statements | Relationships |