{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# Statistics for Nanna's email of 2019-02-13\n", "\n", "Hi Herbert,\n", "\n", "you would be a lifesaver if you could give me some updated information about the following (regarding the Stimmen database):\n", "\n", "- what's the latest breakdown of age, gender, most active language distribution in all the data, for the prediction data, and for the recording data?\n", "- How many individual users are there in the corpus of picture task recordings?\n", "- How many users have made recordings in more than one language? (and if possible a list with the device ids)\n", "- it would be great to have the breakdown of amounts of quiz taking over the months - so how many in september 2017, october 2017, and so on up until september 2018\n", "\n", "Any luck with any of these would be a massive help. I only need the data from 19 September 2017 onwards,\n", "\n", "Nanna" ] }, { "cell_type": "code", "execution_count": 1, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "········\n" ] } ], "source": [ "# Enable portforwording from 3307 locally to 3306 on the stimmen database machine\n", "# ssh -L 3307:127.0.0.1:3306 stimmen.housing.rug.nl\n", "\n", "import pandas\n", "import MySQLdb\n", "from collections import defaultdict, Counter\n", "from ipy_table import make_table, set_row_style\n", "from IPython.display import display\n", "\n", "from getpass import getpass\n", "\n", "if 'mysql_password' not in globals():\n", " mysql_password = getpass()\n", "\n", "db = MySQLdb.connect(host='127.0.0.1', port=3307, user='stimmen', passwd=mysql_password, db='stimmen', charset='utf8')" ] }, { "cell_type": "code", "execution_count": 2, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "core_freespeechresult\n", "core_freespeechtheme\n", "core_language\n", "core_picturegameitem\n", "core_picturegameresult\n", "core_predictionquizresult\n", "core_predictionquizresultquestionanswer\n", "core_surveyanswer\n", "core_surveyquestion\n", "core_surveyquestioncategory\n", "core_surveyresult\n", "core_surveyresultquestionanswer\n" ] } ], "source": [ "# Kind reminded of the table names\n", "print('\\n'.join(\n", " table\n", " for table in pandas.read_sql('''show tables;''', db)['Tables_in_stimmen']\n", " if table.startswith('core_')\n", "))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### What's the latest breakdown of age, gender, most active language distribution in all the data, for the prediction data, and for the recording data?" ] }, { "cell_type": "code", "execution_count": 3, "metadata": {}, "outputs": [], "source": [ "def remove_repeating(rows, columns=[0]):\n", " \"\"\"Empty cells which are the same as the cell above\n", " (in the previous row) for the specified columns, to create\n", " a less redunant and more readable table\"\"\"\n", " return [\n", " [\n", " '' if column == column_ and i in columns else column\n", " for i, (column, column_) in enumerate(zip(row, row_))\n", " ]\n", " for row, row_ in zip(rows, [[None] * len(rows[0])] + rows)\n", " ]" ] }, { "cell_type": "code", "execution_count": 4, "metadata": { "scrolled": true }, "outputs": [ { "data": { "text/html": [ "
prediction quiz
questionanswercount
Total participants15177
No survey11829
With survey3348
What is your age bracket?total answers3348
What is your gender?total answers3348
Which language are you the most proficient in?total answers3348
Which languages do you actively use in your life?total answers7848
What is your age bracket?11-201064
21-30748
41-50424
51-60414
31-40352
61-70239
71-8066
81-9018
0-1016
91-1007
What is your gender?female1689
male1640
other19
Which language are you the most proficient in?Frisian1740
Dutch1487
Bildts33
Stadsfrys33
English17
Other10
German5
Amelands4
Gronings3
Stellingwarfs3
Hindeloopers2
North Frisian2
Ostfriesisches Platt2
Turkish2
Arabic1
Drents1
Mandarin1
Sranan1
Terschellings1
Which languages do you actively use in your life?Dutch2867
Frisian2787
English1169
German335
City Frisian173
French126
Other93
Bildts72
Gronings31
Stellingwarfs26
Norwegian22
Amelands20
Hindeloopers13
Drents12
Arabic9
Terschellings9
Bahasa Indonesia8
Afrikaans7
Sranan7
Papiamentu6
Tarifit6
Turkish6
Mandarin Chinese5
North Frisian5
Ostfriesisches Platt5
Polish5
Niedersächsisch4
Schiermonnikoogs4
Galician3
Ostniederdeutsch3
Latgalīšu volūda2
Latviešu valoda2
Ostfälisch2
Sarnami Hindoestani2
Westfälisch2
" ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "
picture game
questionanswercount
Total participants41655
No survey0
With survey41655
What is your age bracket?total answers41655
What is your gender?total answers41655
Which language are you the most proficient in?total answers41655
Which languages do you actively use in your life?total answers103303
What is your age bracket?21-3010255
11-209756
51-606126
41-505853
31-405661
61-702679
71-801017
91-100146
0-10134
81-9028
What is your gender?female24296
male17047
other312
Which language are you the most proficient in?Frisian20755
Dutch17878
English993
Other702
Stadsfrys449
Bildts419
German235
Gronings40
Amelands31
Drents28
North Frisian27
Turkish21
Galician15
Hindeloopers14
Stellingwarfs14
Arabic13
Terschellings11
Papiamentu10
Which languages do you actively use in your life?Dutch36236
Frisian32716
English17498
German5727
Other2769
City Frisian2350
French2145
Bildts903
Norwegian819
Gronings321
Stellingwarfs286
Amelands263
Drents207
Bahasa Indonesia157
North Frisian125
Tarifit125
Sranan120
Polish117
Niedersächsisch99
Terschellings85
Schiermonnikoogs39
Afrikaans30
Hindeloopers30
Mandarin Chinese26
Arabic22
Turkish21
Ostniederdeutsch19
Papiamentu14
Sarnami Hindoestani10
Westfälisch10
Latviešu valoda9
Ostfriesisches Platt5
" ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "
free speech
questionanswercount
Total participants381
No survey0
With survey381
What is your age bracket?total answers381
What is your gender?total answers381
Which language are you the most proficient in?total answers381
Which languages do you actively use in your life?total answers953
What is your age bracket?11-20116
21-3086
31-4051
41-5042
51-6039
61-7018
71-8012
0-107
91-1006
81-904
What is your gender?male198
female169
other14
Which language are you the most proficient in?Dutch177
Frisian152
English17
Other14
German6
Bildts3
Stadsfrys3
Afrikaans2
North Frisian2
Amelands1
Mandarin1
Ostfriesisches Platt1
Sarnami Hindoestani1
Turkish1
Which languages do you actively use in your life?Dutch303
Frisian263
English169
German46
Other29
City Frisian24
French20
Gronings10
Bahasa Indonesia7
Norwegian7
Bildts6
Sranan6
Drents5
Polish5
Tarifit5
Afrikaans4
Amelands4
Arabic4
Hindeloopers4
Schiermonnikoogs4
Stellingwarfs4
Turkish4
Niedersächsisch3
Sarnami Hindoestani3
Terschellings3
Galician2
Mandarin Chinese2
Westfälisch2
North Frisian1
Ostfriesisches Platt1
Ostfälisch1
Ostniederdeutsch1
Papiamentu1
" ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "for gametype in ['prediction quiz', 'picture game', 'free speech']:\n", " demographics = pandas.read_sql('''\n", " SELECT \n", " answer.question_text AS question,\n", " answer.answer_text AS answer,\n", " game.id AS game_id,\n", " game.survey_result_id AS survey_id\n", " FROM core_{gametype}result AS game\n", " LEFT JOIN core_surveyresultquestionanswer AS answer\n", " ON answer.survey_result_id = game.survey_result_id\n", " WHERE submitted_at > '2017-09-19'\n", " '''.format(\n", " gametype=gametype.replace(' ', '')\n", " ), db)\n", " \n", " table = [\n", " [\n", " question_text,\n", " question_answer,\n", " len(records)\n", " ]\n", " for question_text, answers in demographics.groupby('question')\n", " for question_answer, records in answers.groupby('answer')\n", " ]\n", "\n", " n_participants = len(demographics['game_id'].unique())\n", " n_no_survey = len(demographics[demographics['question'].isna()]['game_id'].unique())\n", " n_with_survey = len(demographics[~demographics['question'].isna()]['game_id'].unique())\n", "\n", " make_table(\n", " [\n", " [gametype, '', ''],\n", " ['question', 'answer', 'count'],\n", " ['Total participants', '', n_participants],\n", " ['No survey', '', n_no_survey],\n", " ['With survey', '', n_with_survey],\n", " ['', '', '']\n", " ] + [\n", " [question, 'total answers', len(answers_)]\n", " for question, answers_ in demographics.groupby('question')\n", " ] + [['', '', '']] +\n", " remove_repeating(sorted(table, key=lambda x: (x[0], -x[2])))\n", " )\n", " set_row_style(1, bold=True)\n", " display(set_row_style(0, bold=True))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How many individual users are there in the corpus of picture task recordings?\n", "\n", "The `core_picturegameresult` table has a `survey_result_id` and a `session_id` to distinguish users. Some sessions have multiple surveys and vice versa. So I figured the survey is the fairest way to distinguish them." ] }, { "cell_type": "code", "execution_count": 5, "metadata": {}, "outputs": [ { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
COUNT(DISTINCT survey_result_id)COUNT(DISTINCT session_id)COUNT(*)
019302469541655
\n", "
" ], "text/plain": [ " COUNT(DISTINCT survey_result_id) COUNT(DISTINCT session_id) COUNT(*)\n", "0 1930 24695 41655" ] }, "execution_count": 5, "metadata": {}, "output_type": "execute_result" } ], "source": [ "pandas.read_sql('''\n", " SELECT COUNT(DISTINCT survey_result_id), COUNT(DISTINCT session_id), COUNT(*)\n", " FROM core_picturegameresult\n", " WHERE submitted_at > \"2017-09-19\"\n", "''', db)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How many users have made recordings in more than one language?\n", "\n", "* and if possible a list with the device ids\n", "* it would be great to have the breakdown of amounts of quiz taking over the months: sep-17, oct-17, ..., sep-18\n", "\n", "There are not so many, these are the ones:" ] }, { "cell_type": "code", "execution_count": 6, "metadata": {}, "outputs": [ { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
year-month# games# surveyslanguages
02017-972English,Nederlands,Frysk,Stadsfrys
12017-1072Frysk,Hielpers,Nederlands
22017-11104Nederlands,Frysk,Français,Sranan
32017-1221Frysk,Nederlands
42018-421Stadsfrys,Nederlands
52018-1121Gronings,Nederlands
\n", "
" ], "text/plain": [ " year-month # games # surveys languages\n", "0 2017-9 7 2 English,Nederlands,Frysk,Stadsfrys\n", "1 2017-10 7 2 Frysk,Hielpers,Nederlands\n", "2 2017-11 10 4 Nederlands,Frysk,Français,Sranan\n", "3 2017-12 2 1 Frysk,Nederlands\n", "4 2018-4 2 1 Stadsfrys,Nederlands\n", "5 2018-11 2 1 Gronings,Nederlands" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "pandas.read_sql('''\n", " SELECT\n", " CONCAT(YEAR(result.submitted_at), '-', MONTH(result.submitted_at)) AS 'year-month',\n", " COUNT(*) AS '# games',\n", " COUNT(DISTINCT result.survey_result_id) AS '# surveys',\n", " GROUP_CONCAT(DISTINCT lang.name SEPARATOR ',') AS 'languages'\n", " FROM core_freespeechresult AS result\n", " LEFT JOIN core_language as lang\n", " ON lang.id = result.language_id\n", " WHERE submitted_at > \"2017-09-19\"\n", " AND result.survey_result_id IN (\n", " SELECT result.survey_result_id\n", " FROM core_freespeechresult AS result\n", " WHERE submitted_at > \"2017-09-19\"\n", " GROUP BY result.survey_result_id\n", " HAVING COUNT(DISTINCT result.language_id) > 1\n", " )\n", " GROUP BY YEAR(result.submitted_at), MONTH(result.submitted_at)\n", "''', db)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "The device ids:" ] }, { "cell_type": "code", "execution_count": 7, "metadata": {}, "outputs": [ { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
device_id
0738191E5-80E4-4D07-A15E-6B7DE881906A
1fb28928ef1703592
2820E203F-1B70-40A8-BD47-04681D07BC9C
31aa95d23fddf3827
4F95F07AE-B524-4256-9171-F7FFA9E49156
5C8F56303-E912-4BC3-AD51-E1CA8B425AE9
6B653C16D-BDA8-4A47-BC6A-C3171D89AF71
7b40fb5e73d431e6b
8C9FD6142-A64A-4AD8-B317-3BB833A11667
9A258D9E9-FD32-4A97-A5A1-A4B72ADFC71D
108190723c74b4b0bf
\n", "
" ], "text/plain": [ " device_id\n", "0 738191E5-80E4-4D07-A15E-6B7DE881906A\n", "1 fb28928ef1703592\n", "2 820E203F-1B70-40A8-BD47-04681D07BC9C\n", "3 1aa95d23fddf3827\n", "4 F95F07AE-B524-4256-9171-F7FFA9E49156\n", "5 C8F56303-E912-4BC3-AD51-E1CA8B425AE9\n", "6 B653C16D-BDA8-4A47-BC6A-C3171D89AF71\n", "7 b40fb5e73d431e6b\n", "8 C9FD6142-A64A-4AD8-B317-3BB833A11667\n", "9 A258D9E9-FD32-4A97-A5A1-A4B72ADFC71D\n", "10 8190723c74b4b0bf" ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "pandas.read_sql('''\n", " SELECT\n", " DISTINCT survey.device_id\n", " FROM core_freespeechresult AS result\n", " LEFT JOIN core_language as lang\n", " ON lang.id = result.language_id\n", " LEFT JOIN core_surveyresult as survey\n", " ON survey.id = result.survey_result_id\n", " WHERE result.submitted_at > \"2017-09-19\"\n", " AND result.survey_result_id IN (\n", " SELECT result.survey_result_id\n", " FROM core_freespeechresult AS result\n", " WHERE result.submitted_at > \"2017-09-19\"\n", " GROUP BY result.survey_result_id\n", " HAVING COUNT(DISTINCT result.language_id) > 1\n", " )\n", "''', db)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "The results:" ] }, { "cell_type": "code", "execution_count": 8, "metadata": { "scrolled": false }, "outputs": [ { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
device_idlanguageidsession_idapp_localesubmitted_attheme_short_texttheme_long_textrecordinglanguage_idspeech_theme_idsurvey_result_idtheme_long_text_entheme_long_text_fytheme_long_text_nltheme_short_text_entheme_short_text_fytheme_short_text_nl
0738191E5-80E4-4D07-A15E-6B7DE881906AStadsfrys1596349CCA2-358F-4AE5-821F-543AD0B9C97Afy2017-09-20 21:05:47What is your word for...What is the word for \"potato\" in your local la...free_speech_recordings/Stadsfrys/2017-09-20/fs...1491539What is the word for \"potato\" in your local la...Wat is it wurd foar \"ierappel\" yn dyn taal?Wat is het woord voor \"aardappel\" in je taal?What is your word for...Wat is dyn wurd foar...Wat is je woord voor...
1738191E5-80E4-4D07-A15E-6B7DE881906AStadsfrys160ACEF45B4-3162-4A5F-B83A-3E39BE140117fy2017-09-20 21:09:51Your own storyTell us your own story herefree_speech_recordings/Stadsfrys/2017-09-20/fs...1431539Tell us your own story hereFertel dyn eigen ferhaal hjirVertel je eigen verhaal hierYour own storyDyn eigen ferhaalJe eigen verhaal
2738191E5-80E4-4D07-A15E-6B7DE881906AFrysk161ACEF45B4-3162-4A5F-B83A-3E39BE140117fy2017-09-20 21:15:01Read a text 3Then the sun began to shine, and the traveler ...free_speech_recordings/Frysk/2017-09-20/fs_rea...181539Then the sun began to shine, and the traveler ...Dêrnei begûn de sinne fûl te skinen en fuorten...Daarna begon de zon krachtig te stralen, en hi...Read a text 3Foarlêze 3Voorlezen 3
3fb28928ef1703592Frysk221androidSessionIdfb28928ef170359258404890608067nl2017-09-23 15:05:05What is your word for...What is the word for \"potato\" in your local la...free_speech_recordings/Frysk/2017-09-23/fs_wha...192951What is the word for \"potato\" in your local la...Wat is it wurd foar \"ierappel\" yn dyn taal?Wat is het woord voor \"aardappel\" in je taal?What is your word for...Wat is dyn wurd foar...Wat is je woord voor...
4fb28928ef1703592Frysk222androidSessionIdfb28928ef170359258618421150746nl2017-09-23 15:08:40Growing upTell us a story about where you grew up?free_speech_recordings/Frysk/2017-09-23/fs_gro...152951Tell us a story about where you grew up?Fertel wat oer wêrst wei komstVertel iets over waar je bent opgegroeid?Growing upOpgroeieOpgroeien
5fb28928ef1703592Nederlands223androidSessionIdfb28928ef170359258714896361595nl2017-09-23 15:10:16Your own storyTell us your own story herefree_speech_recordings/Nederlands/2017-09-23/f...332951Tell us your own story hereFertel dyn eigen ferhaal hjirVertel je eigen verhaal hierYour own storyDyn eigen ferhaalJe eigen verhaal
6fb28928ef1703592English224androidSessionIdfb28928ef170359259137367204559nl2017-09-23 15:17:19Your own storyTell us your own story herefree_speech_recordings/English/2017-09-23/fs_y...232951Tell us your own story hereFertel dyn eigen ferhaal hjirVertel je eigen verhaal hierYour own storyDyn eigen ferhaalJe eigen verhaal
7820E203F-1B70-40A8-BD47-04681D07BC9CNederlands33328F45D4F-71F4-45A3-A9A2-B9813A16EC13nl2017-10-12 08:49:53What is your word for...What is the word for \"potato\" in your local la...free_speech_recordings/Nederlands/2017-10-12/f...395477What is the word for \"potato\" in your local la...Wat is it wurd foar \"ierappel\" yn dyn taal?Wat is het woord voor \"aardappel\" in je taal?What is your word for...Wat is dyn wurd foar...Wat is je woord voor...
8820E203F-1B70-40A8-BD47-04681D07BC9CNederlands33428F45D4F-71F4-45A3-A9A2-B9813A16EC13nl2017-10-12 08:50:49What would you do with a million euros?What would you do with a million euros?free_speech_recordings/Nederlands/2017-10-12/f...345477What would you do with a million euros?Wat soesto dwaan mei €1.000.000?Wat zou je doen met €1.000.000?What would you do with a million euros?Wat soesto dwaan mei €1.000.000?Wat zou je doen met €1.000.000?
9820E203F-1B70-40A8-BD47-04681D07BC9CFrysk33528F45D4F-71F4-45A3-A9A2-B9813A16EC13nl2017-10-12 08:51:51Your own storyTell us your own story herefree_speech_recordings/Frysk/2017-10-12/fs_you...135477Tell us your own story hereFertel dyn eigen ferhaal hjirVertel je eigen verhaal hierYour own storyDyn eigen ferhaalJe eigen verhaal
101aa95d23fddf3827Frysk373androidSessionId1aa95d23fddf3827591709392581151fy2017-10-26 11:10:42What is your word for...What is the word for \"potato\" in your local la...free_speech_recordings/Frysk/2017-10-26/fs_wha...196135What is the word for \"potato\" in your local la...Wat is it wurd foar \"ierappel\" yn dyn taal?Wat is het woord voor \"aardappel\" in je taal?What is your word for...Wat is dyn wurd foar...Wat is je woord voor...
111aa95d23fddf3827Frysk374androidSessionId1aa95d23fddf3827591856351721095fy2017-10-26 11:13:08Read a text 3Then the sun began to shine, and the traveler ...free_speech_recordings/Frysk/2017-10-26/fs_rea...186135Then the sun began to shine, and the traveler ...Dêrnei begûn de sinne fûl te skinen en fuorten...Daarna begon de zon krachtig te stralen, en hi...Read a text 3Foarlêze 3Voorlezen 3
121aa95d23fddf3827Hielpers375androidSessionId1aa95d23fddf3827592248608182404fy2017-10-26 11:19:40Read a text 3Then the sun began to shine, and the traveler ...free_speech_recordings/Hielpers/2017-10-26/fs_...986135Then the sun began to shine, and the traveler ...Dêrnei begûn de sinne fûl te skinen en fuorten...Daarna begon de zon krachtig te stralen, en hi...Read a text 3Foarlêze 3Voorlezen 3
131aa95d23fddf3827Frysk376androidSessionId1aa95d23fddf3827592854579719673fy2017-10-26 11:29:47Growing upTell us a story about where you grew up?free_speech_recordings/Frysk/2017-10-26/fs_gro...156135Tell us a story about where you grew up?Fertel wat oer wêrst wei komstVertel iets over waar je bent opgegroeid?Growing upOpgroeieOpgroeien
14F95F07AE-B524-4256-9171-F7FFA9E49156Frysk38870BBF265-BB3B-4B53-8C1E-9B6CA179906Cfy2017-11-05 11:44:03Growing upTell us a story about where you grew up?free_speech_recordings/Frysk/2017-11-05/fs_gro...156255Tell us a story about where you grew up?Fertel wat oer wêrst wei komstVertel iets over waar je bent opgegroeid?Growing upOpgroeieOpgroeien
15F95F07AE-B524-4256-9171-F7FFA9E49156Frysk38970BBF265-BB3B-4B53-8C1E-9B6CA179906Cfy2017-11-05 11:48:01Read a text 2The North Wind blew as hard as he could, but t...free_speech_recordings/Frysk/2017-11-05/fs_rea...176255The North Wind blew as hard as he could, but t...De noardewyn begûn út alle macht te blazen, ma...De noordenwind begon toen uit alle macht te bl...Read a text 2Foarlêze 2Voorlezen 2
16F95F07AE-B524-4256-9171-F7FFA9E49156Frysk39070BBF265-BB3B-4B53-8C1E-9B6CA179906Cfy2017-11-05 11:48:56What is your word for...What is the word for \"potato\" in your local la...free_speech_recordings/Frysk/2017-11-05/fs_wha...196255What is the word for \"potato\" in your local la...Wat is it wurd foar \"ierappel\" yn dyn taal?Wat is het woord voor \"aardappel\" in je taal?What is your word for...Wat is dyn wurd foar...Wat is je woord voor...
17F95F07AE-B524-4256-9171-F7FFA9E49156Sranan39170BBF265-BB3B-4B53-8C1E-9B6CA179906Cfy2017-11-05 11:52:51Growing upTell us a story about where you grew up?free_speech_recordings/Sranan/2017-11-05/fs_gr...1656255Tell us a story about where you grew up?Fertel wat oer wêrst wei komstVertel iets over waar je bent opgegroeid?Growing upOpgroeieOpgroeien
18C8F56303-E912-4BC3-AD51-E1CA8B425AE9Frysk4100D2F2AD3-177A-4991-AD5F-55CAF1BFDE35nl2017-11-16 13:15:06What is your word for...What is the word for \"potato\" in your local la...free_speech_recordings/Frysk/2017-11-16/fs_wha...196445What is the word for \"potato\" in your local la...Wat is it wurd foar \"ierappel\" yn dyn taal?Wat is het woord voor \"aardappel\" in je taal?What is your word for...Wat is dyn wurd foar...Wat is je woord voor...
19B653C16D-BDA8-4A47-BC6A-C3171D89AF71Frysk41107E90580-694C-4F9C-A82B-D431D88F6508nl2017-11-16 13:16:32What is your word for...What is the word for \"potato\" in your local la...free_speech_recordings/Frysk/2017-11-16/fs_wha...196450What is the word for \"potato\" in your local la...Wat is it wurd foar \"ierappel\" yn dyn taal?Wat is het woord voor \"aardappel\" in je taal?What is your word for...Wat is dyn wurd foar...Wat is je woord voor...
20B653C16D-BDA8-4A47-BC6A-C3171D89AF71Nederlands4124CB961F7-432A-43EE-B748-41CB18DA6ACCnl2017-11-16 13:20:38JokeTell us a joke!free_speech_recordings/Nederlands/2017-11-16/f...326450Tell us a joke!Fertel in mopke!Vertel een mop!JokeMopkeMop
21C8F56303-E912-4BC3-AD51-E1CA8B425AE9Nederlands4140D2F2AD3-177A-4991-AD5F-55CAF1BFDE35nl2017-11-16 13:21:42What is your word for...What is the word for \"potato\" in your local la...free_speech_recordings/Nederlands/2017-11-16/f...396445What is the word for \"potato\" in your local la...Wat is it wurd foar \"ierappel\" yn dyn taal?Wat is het woord voor \"aardappel\" in je taal?What is your word for...Wat is dyn wurd foar...Wat is je woord voor...
22b40fb5e73d431e6bFrysk426androidSessionIdb40fb5e73d431e6b136597419729297nl2017-11-22 13:14:36What is your word for...What is the word for \"potato\" in your local la...free_speech_recordings/Frysk/2017-11-22/fs_wha...196496What is the word for \"potato\" in your local la...Wat is it wurd foar \"ierappel\" yn dyn taal?Wat is het woord voor \"aardappel\" in je taal?What is your word for...Wat is dyn wurd foar...Wat is je woord voor...
23b40fb5e73d431e6bFrançais428androidSessionIdb40fb5e73d431e6b136976454194882nl2017-11-22 13:20:56Your own storyTell us your own story herefree_speech_recordings/Français/2017-11-22/fs_...2236496Tell us your own story hereFertel dyn eigen ferhaal hjirVertel je eigen verhaal hierYour own storyDyn eigen ferhaalJe eigen verhaal
24C9FD6142-A64A-4AD8-B317-3BB833A11667Nederlands4529A976F40-ADF7-4F72-9C2F-9BD4F1AF4DF5nl2017-12-12 10:36:40What would you do with a million euros?What would you do with a million euros?free_speech_recordings/Nederlands/2017-12-12/f...346892What would you do with a million euros?Wat soesto dwaan mei €1.000.000?Wat zou je doen met €1.000.000?What would you do with a million euros?Wat soesto dwaan mei €1.000.000?Wat zou je doen met €1.000.000?
25C9FD6142-A64A-4AD8-B317-3BB833A11667Frysk453372127E4-AFFE-4BF5-BE7A-FF9D981F4D2Enl2017-12-12 10:42:33What is your word for...What is the word for \"potato\" in your local la...free_speech_recordings/Frysk/2017-12-12/fs_wha...196892What is the word for \"potato\" in your local la...Wat is it wurd foar \"ierappel\" yn dyn taal?Wat is het woord voor \"aardappel\" in je taal?What is your word for...Wat is dyn wurd foar...Wat is je woord voor...
26A258D9E9-FD32-4A97-A5A1-A4B72ADFC71DNederlands47663B8E61A-433A-433A-924F-0B2D9D6F0353fy2018-04-08 17:37:12What is your word for...What is the word for \"potato\" in your local la...free_speech_recordings/Nederlands/2018-04-08/f...397372What is the word for \"potato\" in your local la...Wat is it wurd foar \"ierappel\" yn dyn taal?Wat is het woord voor \"aardappel\" in je taal?What is your word for...Wat is dyn wurd foar...Wat is je woord voor...
27A258D9E9-FD32-4A97-A5A1-A4B72ADFC71DStadsfrys47763B8E61A-433A-433A-924F-0B2D9D6F0353fy2018-04-08 17:46:49What would you do with a million euros?What would you do with a million euros?free_speech_recordings/Stadsfrys/2018-04-08/fs...1447372What would you do with a million euros?Wat soesto dwaan mei €1.000.000?Wat zou je doen met €1.000.000?What would you do with a million euros?Wat soesto dwaan mei €1.000.000?Wat zou je doen met €1.000.000?
288190723c74b4b0bfNederlands500androidSessionId8190723c74b4b0bf57887798554061nl2018-11-18 11:03:50Growing upTell us a story about where you grew up?free_speech_recordings/Nederlands/2018-11-18/f...358193Tell us a story about where you grew up?Fertel wat oer wêrst wei komstVertel iets over waar je bent opgegroeid?Growing upOpgroeieOpgroeien
298190723c74b4b0bfGronings501androidSessionId8190723c74b4b0bf58065148631545nl2018-11-18 11:06:50Growing upTell us a story about where you grew up?free_speech_recordings/Gronings/2018-11-18/fs_...458193Tell us a story about where you grew up?Fertel wat oer wêrst wei komstVertel iets over waar je bent opgegroeid?Growing upOpgroeieOpgroeien
\n", "
" ], "text/plain": [ " device_id language id \\\n", "0 738191E5-80E4-4D07-A15E-6B7DE881906A Stadsfrys 159 \n", "1 738191E5-80E4-4D07-A15E-6B7DE881906A Stadsfrys 160 \n", "2 738191E5-80E4-4D07-A15E-6B7DE881906A Frysk 161 \n", "3 fb28928ef1703592 Frysk 221 \n", "4 fb28928ef1703592 Frysk 222 \n", "5 fb28928ef1703592 Nederlands 223 \n", "6 fb28928ef1703592 English 224 \n", "7 820E203F-1B70-40A8-BD47-04681D07BC9C Nederlands 333 \n", "8 820E203F-1B70-40A8-BD47-04681D07BC9C Nederlands 334 \n", "9 820E203F-1B70-40A8-BD47-04681D07BC9C Frysk 335 \n", "10 1aa95d23fddf3827 Frysk 373 \n", "11 1aa95d23fddf3827 Frysk 374 \n", "12 1aa95d23fddf3827 Hielpers 375 \n", "13 1aa95d23fddf3827 Frysk 376 \n", "14 F95F07AE-B524-4256-9171-F7FFA9E49156 Frysk 388 \n", "15 F95F07AE-B524-4256-9171-F7FFA9E49156 Frysk 389 \n", "16 F95F07AE-B524-4256-9171-F7FFA9E49156 Frysk 390 \n", "17 F95F07AE-B524-4256-9171-F7FFA9E49156 Sranan 391 \n", "18 C8F56303-E912-4BC3-AD51-E1CA8B425AE9 Frysk 410 \n", "19 B653C16D-BDA8-4A47-BC6A-C3171D89AF71 Frysk 411 \n", "20 B653C16D-BDA8-4A47-BC6A-C3171D89AF71 Nederlands 412 \n", "21 C8F56303-E912-4BC3-AD51-E1CA8B425AE9 Nederlands 414 \n", "22 b40fb5e73d431e6b Frysk 426 \n", "23 b40fb5e73d431e6b Français 428 \n", "24 C9FD6142-A64A-4AD8-B317-3BB833A11667 Nederlands 452 \n", "25 C9FD6142-A64A-4AD8-B317-3BB833A11667 Frysk 453 \n", "26 A258D9E9-FD32-4A97-A5A1-A4B72ADFC71D Nederlands 476 \n", "27 A258D9E9-FD32-4A97-A5A1-A4B72ADFC71D Stadsfrys 477 \n", "28 8190723c74b4b0bf Nederlands 500 \n", "29 8190723c74b4b0bf Gronings 501 \n", "\n", " session_id app_locale \\\n", "0 6349CCA2-358F-4AE5-821F-543AD0B9C97A fy \n", "1 ACEF45B4-3162-4A5F-B83A-3E39BE140117 fy \n", "2 ACEF45B4-3162-4A5F-B83A-3E39BE140117 fy \n", "3 androidSessionIdfb28928ef170359258404890608067 nl \n", "4 androidSessionIdfb28928ef170359258618421150746 nl \n", "5 androidSessionIdfb28928ef170359258714896361595 nl \n", "6 androidSessionIdfb28928ef170359259137367204559 nl \n", "7 28F45D4F-71F4-45A3-A9A2-B9813A16EC13 nl \n", "8 28F45D4F-71F4-45A3-A9A2-B9813A16EC13 nl \n", "9 28F45D4F-71F4-45A3-A9A2-B9813A16EC13 nl \n", "10 androidSessionId1aa95d23fddf3827591709392581151 fy \n", "11 androidSessionId1aa95d23fddf3827591856351721095 fy \n", "12 androidSessionId1aa95d23fddf3827592248608182404 fy \n", "13 androidSessionId1aa95d23fddf3827592854579719673 fy \n", "14 70BBF265-BB3B-4B53-8C1E-9B6CA179906C fy \n", "15 70BBF265-BB3B-4B53-8C1E-9B6CA179906C fy \n", "16 70BBF265-BB3B-4B53-8C1E-9B6CA179906C fy \n", "17 70BBF265-BB3B-4B53-8C1E-9B6CA179906C fy \n", "18 0D2F2AD3-177A-4991-AD5F-55CAF1BFDE35 nl \n", "19 07E90580-694C-4F9C-A82B-D431D88F6508 nl \n", "20 4CB961F7-432A-43EE-B748-41CB18DA6ACC nl \n", "21 0D2F2AD3-177A-4991-AD5F-55CAF1BFDE35 nl \n", "22 androidSessionIdb40fb5e73d431e6b136597419729297 nl \n", "23 androidSessionIdb40fb5e73d431e6b136976454194882 nl \n", "24 9A976F40-ADF7-4F72-9C2F-9BD4F1AF4DF5 nl \n", "25 372127E4-AFFE-4BF5-BE7A-FF9D981F4D2E nl \n", "26 63B8E61A-433A-433A-924F-0B2D9D6F0353 fy \n", "27 63B8E61A-433A-433A-924F-0B2D9D6F0353 fy \n", "28 androidSessionId8190723c74b4b0bf57887798554061 nl \n", "29 androidSessionId8190723c74b4b0bf58065148631545 nl \n", "\n", " submitted_at theme_short_text \\\n", "0 2017-09-20 21:05:47 What is your word for... \n", "1 2017-09-20 21:09:51 Your own story \n", "2 2017-09-20 21:15:01 Read a text 3 \n", "3 2017-09-23 15:05:05 What is your word for... \n", "4 2017-09-23 15:08:40 Growing up \n", "5 2017-09-23 15:10:16 Your own story \n", "6 2017-09-23 15:17:19 Your own story \n", "7 2017-10-12 08:49:53 What is your word for... \n", "8 2017-10-12 08:50:49 What would you do with a million euros? \n", "9 2017-10-12 08:51:51 Your own story \n", "10 2017-10-26 11:10:42 What is your word for... \n", "11 2017-10-26 11:13:08 Read a text 3 \n", "12 2017-10-26 11:19:40 Read a text 3 \n", "13 2017-10-26 11:29:47 Growing up \n", "14 2017-11-05 11:44:03 Growing up \n", "15 2017-11-05 11:48:01 Read a text 2 \n", "16 2017-11-05 11:48:56 What is your word for... \n", "17 2017-11-05 11:52:51 Growing up \n", "18 2017-11-16 13:15:06 What is your word for... \n", "19 2017-11-16 13:16:32 What is your word for... \n", "20 2017-11-16 13:20:38 Joke \n", "21 2017-11-16 13:21:42 What is your word for... \n", "22 2017-11-22 13:14:36 What is your word for... \n", "23 2017-11-22 13:20:56 Your own story \n", "24 2017-12-12 10:36:40 What would you do with a million euros? \n", "25 2017-12-12 10:42:33 What is your word for... \n", "26 2018-04-08 17:37:12 What is your word for... \n", "27 2018-04-08 17:46:49 What would you do with a million euros? \n", "28 2018-11-18 11:03:50 Growing up \n", "29 2018-11-18 11:06:50 Growing up \n", "\n", " theme_long_text \\\n", "0 What is the word for \"potato\" in your local la... \n", "1 Tell us your own story here \n", "2 Then the sun began to shine, and the traveler ... \n", "3 What is the word for \"potato\" in your local la... \n", "4 Tell us a story about where you grew up? \n", "5 Tell us your own story here \n", "6 Tell us your own story here \n", "7 What is the word for \"potato\" in your local la... \n", "8 What would you do with a million euros? \n", "9 Tell us your own story here \n", "10 What is the word for \"potato\" in your local la... \n", "11 Then the sun began to shine, and the traveler ... \n", "12 Then the sun began to shine, and the traveler ... \n", "13 Tell us a story about where you grew up? \n", "14 Tell us a story about where you grew up? \n", "15 The North Wind blew as hard as he could, but t... \n", "16 What is the word for \"potato\" in your local la... \n", "17 Tell us a story about where you grew up? \n", "18 What is the word for \"potato\" in your local la... \n", "19 What is the word for \"potato\" in your local la... \n", "20 Tell us a joke! \n", "21 What is the word for \"potato\" in your local la... \n", "22 What is the word for \"potato\" in your local la... \n", "23 Tell us your own story here \n", "24 What would you do with a million euros? \n", "25 What is the word for \"potato\" in your local la... \n", "26 What is the word for \"potato\" in your local la... \n", "27 What would you do with a million euros? \n", "28 Tell us a story about where you grew up? \n", "29 Tell us a story about where you grew up? \n", "\n", " recording language_id \\\n", "0 free_speech_recordings/Stadsfrys/2017-09-20/fs... 14 \n", "1 free_speech_recordings/Stadsfrys/2017-09-20/fs... 14 \n", "2 free_speech_recordings/Frysk/2017-09-20/fs_rea... 1 \n", "3 free_speech_recordings/Frysk/2017-09-23/fs_wha... 1 \n", "4 free_speech_recordings/Frysk/2017-09-23/fs_gro... 1 \n", "5 free_speech_recordings/Nederlands/2017-09-23/f... 3 \n", "6 free_speech_recordings/English/2017-09-23/fs_y... 2 \n", "7 free_speech_recordings/Nederlands/2017-10-12/f... 3 \n", "8 free_speech_recordings/Nederlands/2017-10-12/f... 3 \n", "9 free_speech_recordings/Frysk/2017-10-12/fs_you... 1 \n", "10 free_speech_recordings/Frysk/2017-10-26/fs_wha... 1 \n", "11 free_speech_recordings/Frysk/2017-10-26/fs_rea... 1 \n", "12 free_speech_recordings/Hielpers/2017-10-26/fs_... 9 \n", "13 free_speech_recordings/Frysk/2017-10-26/fs_gro... 1 \n", "14 free_speech_recordings/Frysk/2017-11-05/fs_gro... 1 \n", "15 free_speech_recordings/Frysk/2017-11-05/fs_rea... 1 \n", "16 free_speech_recordings/Frysk/2017-11-05/fs_wha... 1 \n", "17 free_speech_recordings/Sranan/2017-11-05/fs_gr... 16 \n", "18 free_speech_recordings/Frysk/2017-11-16/fs_wha... 1 \n", "19 free_speech_recordings/Frysk/2017-11-16/fs_wha... 1 \n", "20 free_speech_recordings/Nederlands/2017-11-16/f... 3 \n", "21 free_speech_recordings/Nederlands/2017-11-16/f... 3 \n", "22 free_speech_recordings/Frysk/2017-11-22/fs_wha... 1 \n", "23 free_speech_recordings/Français/2017-11-22/fs_... 22 \n", "24 free_speech_recordings/Nederlands/2017-12-12/f... 3 \n", "25 free_speech_recordings/Frysk/2017-12-12/fs_wha... 1 \n", "26 free_speech_recordings/Nederlands/2018-04-08/f... 3 \n", "27 free_speech_recordings/Stadsfrys/2018-04-08/fs... 14 \n", "28 free_speech_recordings/Nederlands/2018-11-18/f... 3 \n", "29 free_speech_recordings/Gronings/2018-11-18/fs_... 4 \n", "\n", " speech_theme_id survey_result_id \\\n", "0 9 1539 \n", "1 3 1539 \n", "2 8 1539 \n", "3 9 2951 \n", "4 5 2951 \n", "5 3 2951 \n", "6 3 2951 \n", "7 9 5477 \n", "8 4 5477 \n", "9 3 5477 \n", "10 9 6135 \n", "11 8 6135 \n", "12 8 6135 \n", "13 5 6135 \n", "14 5 6255 \n", "15 7 6255 \n", "16 9 6255 \n", "17 5 6255 \n", "18 9 6445 \n", "19 9 6450 \n", "20 2 6450 \n", "21 9 6445 \n", "22 9 6496 \n", "23 3 6496 \n", "24 4 6892 \n", "25 9 6892 \n", "26 9 7372 \n", "27 4 7372 \n", "28 5 8193 \n", "29 5 8193 \n", "\n", " theme_long_text_en \\\n", "0 What is the word for \"potato\" in your local la... \n", "1 Tell us your own story here \n", "2 Then the sun began to shine, and the traveler ... \n", "3 What is the word for \"potato\" in your local la... \n", "4 Tell us a story about where you grew up? \n", "5 Tell us your own story here \n", "6 Tell us your own story here \n", "7 What is the word for \"potato\" in your local la... \n", "8 What would you do with a million euros? \n", "9 Tell us your own story here \n", "10 What is the word for \"potato\" in your local la... \n", "11 Then the sun began to shine, and the traveler ... \n", "12 Then the sun began to shine, and the traveler ... \n", "13 Tell us a story about where you grew up? \n", "14 Tell us a story about where you grew up? \n", "15 The North Wind blew as hard as he could, but t... \n", "16 What is the word for \"potato\" in your local la... \n", "17 Tell us a story about where you grew up? \n", "18 What is the word for \"potato\" in your local la... \n", "19 What is the word for \"potato\" in your local la... \n", "20 Tell us a joke! \n", "21 What is the word for \"potato\" in your local la... \n", "22 What is the word for \"potato\" in your local la... \n", "23 Tell us your own story here \n", "24 What would you do with a million euros? \n", "25 What is the word for \"potato\" in your local la... \n", "26 What is the word for \"potato\" in your local la... \n", "27 What would you do with a million euros? \n", "28 Tell us a story about where you grew up? \n", "29 Tell us a story about where you grew up? \n", "\n", " theme_long_text_fy \\\n", "0 Wat is it wurd foar \"ierappel\" yn dyn taal? \n", "1 Fertel dyn eigen ferhaal hjir \n", "2 Dêrnei begûn de sinne fûl te skinen en fuorten... \n", "3 Wat is it wurd foar \"ierappel\" yn dyn taal? \n", "4 Fertel wat oer wêrst wei komst \n", "5 Fertel dyn eigen ferhaal hjir \n", "6 Fertel dyn eigen ferhaal hjir \n", "7 Wat is it wurd foar \"ierappel\" yn dyn taal? \n", "8 Wat soesto dwaan mei €1.000.000? \n", "9 Fertel dyn eigen ferhaal hjir \n", "10 Wat is it wurd foar \"ierappel\" yn dyn taal? \n", "11 Dêrnei begûn de sinne fûl te skinen en fuorten... \n", "12 Dêrnei begûn de sinne fûl te skinen en fuorten... \n", "13 Fertel wat oer wêrst wei komst \n", "14 Fertel wat oer wêrst wei komst \n", "15 De noardewyn begûn út alle macht te blazen, ma... \n", "16 Wat is it wurd foar \"ierappel\" yn dyn taal? \n", "17 Fertel wat oer wêrst wei komst \n", "18 Wat is it wurd foar \"ierappel\" yn dyn taal? \n", "19 Wat is it wurd foar \"ierappel\" yn dyn taal? \n", "20 Fertel in mopke! \n", "21 Wat is it wurd foar \"ierappel\" yn dyn taal? \n", "22 Wat is it wurd foar \"ierappel\" yn dyn taal? \n", "23 Fertel dyn eigen ferhaal hjir \n", "24 Wat soesto dwaan mei €1.000.000? \n", "25 Wat is it wurd foar \"ierappel\" yn dyn taal? \n", "26 Wat is it wurd foar \"ierappel\" yn dyn taal? \n", "27 Wat soesto dwaan mei €1.000.000? \n", "28 Fertel wat oer wêrst wei komst \n", "29 Fertel wat oer wêrst wei komst \n", "\n", " theme_long_text_nl \\\n", "0 Wat is het woord voor \"aardappel\" in je taal? \n", "1 Vertel je eigen verhaal hier \n", "2 Daarna begon de zon krachtig te stralen, en hi... \n", "3 Wat is het woord voor \"aardappel\" in je taal? \n", "4 Vertel iets over waar je bent opgegroeid? \n", "5 Vertel je eigen verhaal hier \n", "6 Vertel je eigen verhaal hier \n", "7 Wat is het woord voor \"aardappel\" in je taal? \n", "8 Wat zou je doen met €1.000.000? \n", "9 Vertel je eigen verhaal hier \n", "10 Wat is het woord voor \"aardappel\" in je taal? \n", "11 Daarna begon de zon krachtig te stralen, en hi... \n", "12 Daarna begon de zon krachtig te stralen, en hi... \n", "13 Vertel iets over waar je bent opgegroeid? \n", "14 Vertel iets over waar je bent opgegroeid? \n", "15 De noordenwind begon toen uit alle macht te bl... \n", "16 Wat is het woord voor \"aardappel\" in je taal? \n", "17 Vertel iets over waar je bent opgegroeid? \n", "18 Wat is het woord voor \"aardappel\" in je taal? \n", "19 Wat is het woord voor \"aardappel\" in je taal? \n", "20 Vertel een mop! \n", "21 Wat is het woord voor \"aardappel\" in je taal? \n", "22 Wat is het woord voor \"aardappel\" in je taal? \n", "23 Vertel je eigen verhaal hier \n", "24 Wat zou je doen met €1.000.000? \n", "25 Wat is het woord voor \"aardappel\" in je taal? \n", "26 Wat is het woord voor \"aardappel\" in je taal? \n", "27 Wat zou je doen met €1.000.000? \n", "28 Vertel iets over waar je bent opgegroeid? \n", "29 Vertel iets over waar je bent opgegroeid? \n", "\n", " theme_short_text_en theme_short_text_fy \\\n", "0 What is your word for... Wat is dyn wurd foar... \n", "1 Your own story Dyn eigen ferhaal \n", "2 Read a text 3 Foarlêze 3 \n", "3 What is your word for... Wat is dyn wurd foar... \n", "4 Growing up Opgroeie \n", "5 Your own story Dyn eigen ferhaal \n", "6 Your own story Dyn eigen ferhaal \n", "7 What is your word for... Wat is dyn wurd foar... \n", "8 What would you do with a million euros? Wat soesto dwaan mei €1.000.000? \n", "9 Your own story Dyn eigen ferhaal \n", "10 What is your word for... Wat is dyn wurd foar... \n", "11 Read a text 3 Foarlêze 3 \n", "12 Read a text 3 Foarlêze 3 \n", "13 Growing up Opgroeie \n", "14 Growing up Opgroeie \n", "15 Read a text 2 Foarlêze 2 \n", "16 What is your word for... Wat is dyn wurd foar... \n", "17 Growing up Opgroeie \n", "18 What is your word for... Wat is dyn wurd foar... \n", "19 What is your word for... Wat is dyn wurd foar... \n", "20 Joke Mopke \n", "21 What is your word for... Wat is dyn wurd foar... \n", "22 What is your word for... Wat is dyn wurd foar... \n", "23 Your own story Dyn eigen ferhaal \n", "24 What would you do with a million euros? Wat soesto dwaan mei €1.000.000? \n", "25 What is your word for... Wat is dyn wurd foar... \n", "26 What is your word for... Wat is dyn wurd foar... \n", "27 What would you do with a million euros? Wat soesto dwaan mei €1.000.000? \n", "28 Growing up Opgroeie \n", "29 Growing up Opgroeie \n", "\n", " theme_short_text_nl \n", "0 Wat is je woord voor... \n", "1 Je eigen verhaal \n", "2 Voorlezen 3 \n", "3 Wat is je woord voor... \n", "4 Opgroeien \n", "5 Je eigen verhaal \n", "6 Je eigen verhaal \n", "7 Wat is je woord voor... \n", "8 Wat zou je doen met €1.000.000? \n", "9 Je eigen verhaal \n", "10 Wat is je woord voor... \n", "11 Voorlezen 3 \n", "12 Voorlezen 3 \n", "13 Opgroeien \n", "14 Opgroeien \n", "15 Voorlezen 2 \n", "16 Wat is je woord voor... \n", "17 Opgroeien \n", "18 Wat is je woord voor... \n", "19 Wat is je woord voor... \n", "20 Mop \n", "21 Wat is je woord voor... \n", "22 Wat is je woord voor... \n", "23 Je eigen verhaal \n", "24 Wat zou je doen met €1.000.000? \n", "25 Wat is je woord voor... \n", "26 Wat is je woord voor... \n", "27 Wat zou je doen met €1.000.000? \n", "28 Opgroeien \n", "29 Opgroeien " ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "pandas.read_sql('''\n", " SELECT\n", " survey.device_id,\n", " lang.name as language,\n", " result.*\n", " FROM core_freespeechresult AS result\n", " LEFT JOIN core_language as lang\n", " ON lang.id = result.language_id\n", " LEFT JOIN core_surveyresult as survey\n", " ON survey.id = result.survey_result_id\n", " WHERE result.submitted_at > \"2017-09-19\"\n", " AND result.survey_result_id IN (\n", " SELECT result.survey_result_id\n", " FROM core_freespeechresult AS result\n", " WHERE submitted_at > \"2017-09-19\"\n", " GROUP BY result.survey_result_id\n", " HAVING COUNT(DISTINCT result.language_id) > 1\n", " )\n", "''', db)" ] }, { "cell_type": "code", "execution_count": 9, "metadata": {}, "outputs": [ { "data": { "text/html": [ "
core_freespeechresultcore_picturegameresultcore_predictionquizresultcore_surveyresult
2017-091722141688374413
2017-1078928623641307
2017-11513586701464
2017-12321642997466
2018-01238710146
2018-0211478328
2018-03030413953
2018-04121851524294
2018-050563327127
2018-063268173112
2018-07011814897
2018-081194215114
2018-09011611747
2018-10720010790
2018-11157366759
2018-122736627
2019-015624137100
2019-020634924
2019-030812513
" ], "text/plain": [ "" ] }, "execution_count": 9, "metadata": {}, "output_type": "execute_result" } ], "source": [ "allcounts = dict()\n", "tables = ['core_freespeechresult', 'core_picturegameresult', 'core_predictionquizresult', 'core_surveyresult']\n", "for table in tables:\n", " counts = pandas.read_sql('''\n", " SELECT\n", " CONCAT(YEAR(result.submitted_at), '-', MONTH(result.submitted_at)) AS 'year-month',\n", " COUNT(*) AS '# games'\n", " FROM {table} AS result\n", " WHERE submitted_at > \"2017-09-19\"\n", " GROUP BY YEAR(result.submitted_at), MONTH(result.submitted_at)\n", " '''.format(table=table), db)\n", " allcounts[table] = dict(zip(\n", " ['-'.join('{:02d}'.format(int(d)) for d in date.split('-')) for date in counts['year-month']],\n", " counts['# games']\n", " ))\n", " \n", "dates = sorted({\n", " date for dates in allcounts.values() for date in dates\n", "})\n", "make_table([[''] + tables] + [\n", " [date] + [allcounts[table].get(date, 0) for table in tables]\n", " for date in dates\n", "])" ] }, { "cell_type": "code", "execution_count": 10, "metadata": {}, "outputs": [ { "data": { "text/html": [ "
core_freespeechresult2019-01-30T19:40:03.000000000435
core_picturegameresult2019-03-09T00:59:58.00000000047672
core_predictionquizresult2019-03-13T04:21:56.00000000015522
core_surveyresult2019-03-12T14:48:58.0000000008321
" ], "text/plain": [ "" ] }, "execution_count": 10, "metadata": {}, "output_type": "execute_result" } ], "source": [ "make_table([\n", " [\n", " table,\n", " pandas.read_sql('''\n", " SELECT MAX(submitted_at) FROM {table}\n", " '''.format(table=table), db).values[0, 0],\n", " pandas.read_sql('''\n", " SELECT COUNT(*) FROM {table}\n", " '''.format(table=table), db).values[0, 0]\n", " ]\n", " for table in pandas.read_sql('''\n", " SHOW TABLES\n", " ''', db).values[:, 0]\n", " if 'submitted_at' in set(pandas.read_sql('''\n", " DESCRIBE {table}\n", " '''.format(table=table), db)['Field'])\n", "])" ] } ], "metadata": { "kernelspec": { "display_name": "Python 3", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.6.5" } }, "nbformat": 4, "nbformat_minor": 2 }