Africa Education¶

This example uses the 'Africa Education' dataset to predict student performance. You can download the Jupyter Notebook of the study here.

COUNTRY : COUNTRY ID
REGION : REGION ID
SCHOOL : SCHOOL ID
PUPIL : STUDENT ID
province : School Province
schoolname : School Name
lat : School Latitude
long : School Longitude
country_long : Country Name
zralocp : Student's standardized reading score
zmalocp : Student's standardized mathematics score
ZRALEVP : Student's reading level
ZMALEVP : Student's mathematics competency level
zraloct : Teacher's standardized reading score
zmaloct : Teacher's standardized mathematics score
ZRALEVT : Student's reading competency level Teacher
ZMALEVT : Student's mathematics competency level Teacher
zsdist : School average distance from clinic, road, public, library, book shop & secondary school
XNUMYRS : Teacher's years of teaching
numstu : Number of students at each school
PSEX : Student's sex
PNURSERY : Student preschool
PENGLISH : Student speaks English at home
PMALIVE : Student's biological mother alive
PFALIVE : Student's biological father alive
PTRAVEL : Travels to school
PTRAVEL2 : Means of transportation to school
PMOTHER : Mother's education
PFATHER : Father's education
PLIGHT : Source of lighting
PABSENT : Days absent
PREPEAT : Years repeated
STYPE : School type
SLOCAT : School location
SQACADEM : Academic qualifications
XSEX : Teacher's sex
XAGE : Teacher's age
XQPERMNT : Teacher's employment status
XQPROFES : Teacher's training
zpsibs : Student's number of siblings
zpsit : Seating location
zpmealsc : Free school meals
zphmwkhl : Homework help
zpses : Student's socioeconomic status
PAGE : Student's Age
SINS2006 : School inspection
SPUPPR04 : Student dropout
SPUPPR06 : Student cheats
SPUPPR07 : Student uses abusive language
SPUPPR08 : Student vandalism
SPUPPR09 : Student theft
SPUPPR10 : Student bullies students
SPUPPR11 : Student bullies staff
SPUPPR12 : Student injures staff
SPUPPR13 : Student sexually harrasses students
SPUPPR14 : Student sexually harrasses teachers
SPUPPR15 : Student drug abuse
SPUPPR16 : Student alcohol abuse
SPUPPR17 : Student fights
STCHPR04 : Teacher bullies students
STCHPR05 : Teacher sexually harasses teachers
STCHPR06 : Teacher sexually harasses students
STCHPR07 : Teacher uses abusive language
STCHPR08 : Teacher drug abuse
STCHPR09 : Teacher alcohol abuse

We will follow the data science cycle (Data Exploration - Data Preparation - Data Modeling - Model Evaluation - Model Deployment) to solve this problem.

Initialization¶

This example uses the following version of VerticaPy:

In [1]:

import verticapy as vp
vp.__version__

Out[1]:

'0.9.0'

Connect to Vertica. This example uses an existing connection called "VerticaDSN." For details on how to create a connection, use see the connection tutorial.

In [2]:

vp.connect("VerticaDSN")

Let's create a Virtual DataFrame of the dataset. The dataset is available here.

In [3]:

africa = vp.read_csv("data/africa_education.csv")
display(africa)

	123 PABSENT Int	Abc STCHPR05 Varchar(20)	Abc SPUPPR16 Varchar(20)	Abc zpmealsc Varchar(38)	Abc PREPEAT Varchar(20)	123 zmaloct Float	123 zpses Numeric(7,3)	Abc SPUPPR06 Varchar(20)	123 zraloct Float	Abc COUNTRY Varchar(20)	Abc XSEX Varchar(20)	🌎 lon Numeric(11,7)	123 zralocp Float	Abc district Varchar(46)	123 SCHOOL Int	123 ZRALEVP Int	Abc SPUPPR13 Varchar(20)	123 ZRALEVT Numeric(6,3)	Abc SPUPPR09 Varchar(20)	Abc SPUPPR10 Varchar(20)	Abc zpsit Varchar(54)	Abc PNURSERY Varchar(38)	Abc STCHPR08 Varchar(20)	Abc country_long Varchar(24)	Abc XQPROFES Varchar(20)	...	123 zsdist Numeric(7,2)	Abc PSEX Varchar(20)	Abc SLOCAT Varchar(20)	123 ZMALEVP Numeric(6,3)	Abc province Varchar(44)	Abc zphmwkhl Varchar(56)	Abc XQPERMNT Varchar(36)	Abc SPUPPR04 Varchar(20)	Abc SPUPPR11 Varchar(20)	Abc STCHPR07 Varchar(20)	Abc SQACADEM Varchar(22)	Abc STCHPR04 Varchar(20)	123 SINS2006 Numeric(7,3)	123 numstu Int	123 ZMALEVT Numeric(6,3)	010 PFALIVE Boolean	Abc STCHPR09 Varchar(20)	Abc SPUPPR15 Varchar(20)	Abc PENGLISH Varchar(32)	Abc SPUPPR12 Varchar(20)	123 zpsibs Int	123 XAGE Numeric(7,3)	Abc SPUPPR08 Varchar(20)	123 PAGE Int	Abc Varchar(116)
1	0	NEVER	NEVER	No	NEVER	469.293690770499	15.0	SOMETIMES	[null]	SOU	FEMALE	30.867464	726.682103722197	KZ	500214970	8	SOMETIMES	[null]	SOMETIMES	OFTEN	I have my own sitting place	THREE OR MORE YEARS	NEVER	South Africa	3 YRS TT	...	3.0	GIRL	LARGE CITY	5.0	UMLAZI	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	A-LEVEL	SOMETIMES	0.0	24	3.0	❌	NEVER	NEVER	ALL THE TIME	NEVER	1	48.0	SOMETIMES	12
2	0	NEVER	NEVER	No	NEVER	492.584863319675	5.0	SOMETIMES	581.994282503848	NAM	FEMALE	16.252329	428.150211557773	Windhoek Rural	8800	3	NEVER	6.0	SOMETIMES	SOMETIMES	I have my own sitting place	THREE OR MORE YEARS	NEVER	Namibia	>3 YRS TT	...	1.6	BOY	LARGE CITY	2.0	Khomas	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	SOMETIMES	2.0	23	3.0	✅	NEVER	NEVER	SOMETIMES	NEVER	8	34.0	SOMETIMES	14
3	0	NEVER	NEVER	No	NEVER	492.584863319675	7.0	SOMETIMES	581.994282503848	NAM	FEMALE	16.252329	533.542461027961	Windhoek Rural	8800	5	NEVER	6.0	SOMETIMES	SOMETIMES	I have my own sitting place	ONE YEAR	NEVER	Namibia	>3 YRS TT	...	1.6	BOY	LARGE CITY	4.0	Khomas	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	SOMETIMES	2.0	23	3.0	✅	NEVER	NEVER	SOMETIMES	NEVER	3	34.0	SOMETIMES	13
4	0	NEVER	NEVER	No	NEVER	492.584863319675	8.0	SOMETIMES	581.994282503848	NAM	FEMALE	16.252329	551.091939672771	Windhoek Rural	8800	5	NEVER	6.0	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Namibia	>3 YRS TT	...	1.6	BOY	LARGE CITY	3.0	Khomas	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	SOMETIMES	2.0	23	3.0	✅	NEVER	NEVER	SOMETIMES	NEVER	0	34.0	SOMETIMES	12
5	0	NEVER	NEVER	No	NEVER	492.584863319675	9.0	SOMETIMES	581.994282503848	NAM	FEMALE	16.252329	578.46531125462	Windhoek Rural	8800	6	NEVER	6.0	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Namibia	>3 YRS TT	...	1.6	GIRL	LARGE CITY	4.0	Khomas	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	SOMETIMES	2.0	23	3.0	✅	NEVER	NEVER	SOMETIMES	NEVER	4	34.0	SOMETIMES	13
6	0	NEVER	NEVER	No	NEVER	492.584863319675	11.0	SOMETIMES	581.994282503848	NAM	FEMALE	16.252329	588.003071387669	Windhoek Rural	8800	6	NEVER	6.0	SOMETIMES	SOMETIMES	I have my own sitting place	TWO YEARS	NEVER	Namibia	>3 YRS TT	...	1.6	GIRL	LARGE CITY	3.0	Khomas	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	SOMETIMES	2.0	23	3.0	✅	NEVER	NEVER	MOST OF THE TIME	NEVER	2	34.0	SOMETIMES	12
7	0	NEVER	NEVER	No	NEVER	492.584863319675	11.0	SOMETIMES	581.994282503848	NAM	FEMALE	16.252329	664.972795661372	Windhoek Rural	8800	7	NEVER	6.0	SOMETIMES	SOMETIMES	I have my own sitting place	ONE YEAR	NEVER	Namibia	>3 YRS TT	...	1.6	GIRL	LARGE CITY	3.0	Khomas	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	SOMETIMES	2.0	23	3.0	✅	NEVER	NEVER	MOST OF THE TIME	NEVER	3	34.0	SOMETIMES	12
8	0	NEVER	NEVER	No	NEVER	492.584863319675	12.0	SOMETIMES	581.994282503848	NAM	FEMALE	16.252329	618.237771009434	Windhoek Rural	8800	6	NEVER	6.0	SOMETIMES	SOMETIMES	I have my own sitting place	ONE YEAR	NEVER	Namibia	>3 YRS TT	...	1.6	GIRL	LARGE CITY	4.0	Khomas	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	SOMETIMES	2.0	23	3.0	✅	NEVER	NEVER	SOMETIMES	NEVER	1	34.0	SOMETIMES	12
9	0	NEVER	NEVER	No	NEVER	492.584863319675	12.0	SOMETIMES	581.994282503848	NAM	FEMALE	16.252329	524.863099306887	Windhoek Rural	8800	5	NEVER	6.0	SOMETIMES	SOMETIMES	I have my own sitting place	ONE YEAR	NEVER	Namibia	>3 YRS TT	...	1.6	GIRL	LARGE CITY	3.0	Khomas	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	SOMETIMES	2.0	23	3.0	✅	NEVER	NEVER	SOMETIMES	NEVER	2	34.0	SOMETIMES	14
10	0	NEVER	NEVER	No	NEVER	496.97305524923	10.0	NEVER	601.83282358059	MOZ	FEMALE	37.382725	577.225402437324	Muecate	61375	6	NEVER	6.0	NEVER	NEVER	I have my own sitting place	NEVER	NEVER	Mozambique	2 YRS TT	...	1.0	GIRL	LARGE CITY	3.0	Nampula	Most of time/Always corrects	TEMPORARY GOVT	SOMETIMES	NEVER	NEVER	SENIOR SEC	NEVER	7.0	22	3.0	✅	NEVER	NEVER	ALL THE TIME	NEVER	4	34.0	SOMETIMES	13
11	0	NEVER	NEVER	No	NEVER	533.203768103504	3.0	NEVER	715.046036359878	ZAN	FEMALE	39.8083	417.181787404767	NORTH 'A'	25	3	NEVER	8.0	OFTEN	NEVER	I have my own sitting place	NEVER	NEVER	Zanzibar	2 YRS TT	...	11.4	BOY	RURAL	2.0	NORTH UNGUJA	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	A-LEVEL	SOMETIMES	4.0	25	4.0	✅	NEVER	NEVER	ALL THE TIME	NEVER	7	26.0	OFTEN	13
12	0	NEVER	NEVER	No	NEVER	533.203768103504	3.0	NEVER	715.046036359878	ZAN	FEMALE	39.8083	584.760232942433	NORTH 'A'	25	6	NEVER	8.0	OFTEN	NEVER	I have my own sitting place	NEVER	NEVER	Zanzibar	2 YRS TT	...	11.4	BOY	RURAL	2.0	NORTH UNGUJA	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	A-LEVEL	SOMETIMES	4.0	25	4.0	❌	NEVER	NEVER	ALL THE TIME	NEVER	2	26.0	OFTEN	13
13	0	NEVER	NEVER	No	NEVER	533.203768103504	4.0	NEVER	715.046036359878	ZAN	FEMALE	39.8083	447.321109425201	NORTH 'A'	25	3	NEVER	8.0	OFTEN	NEVER	I have my own sitting place	NEVER	NEVER	Zanzibar	2 YRS TT	...	11.4	BOY	RURAL	2.0	NORTH UNGUJA	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	A-LEVEL	SOMETIMES	4.0	25	4.0	✅	NEVER	NEVER	ALL THE TIME	NEVER	7	26.0	OFTEN	14
14	0	NEVER	NEVER	No	NEVER	533.203768103504	5.0	NEVER	715.046036359878	ZAN	FEMALE	39.8083	476.220522628338	NORTH 'A'	25	4	NEVER	8.0	OFTEN	NEVER	I have my own sitting place	NEVER	NEVER	Zanzibar	2 YRS TT	...	11.4	BOY	RURAL	2.0	NORTH UNGUJA	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	A-LEVEL	SOMETIMES	4.0	25	4.0	✅	NEVER	NEVER	ALL THE TIME	NEVER	5	26.0	OFTEN	14
15	0	NEVER	NEVER	No	NEVER	533.203768103504	5.0	NEVER	715.046036359878	ZAN	FEMALE	39.8083	485.758282761387	NORTH 'A'	25	4	NEVER	8.0	OFTEN	NEVER	I have my own sitting place	NEVER	NEVER	Zanzibar	2 YRS TT	...	11.4	GIRL	RURAL	2.0	NORTH UNGUJA	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	A-LEVEL	SOMETIMES	4.0	25	4.0	❌	NEVER	NEVER	ALL THE TIME	NEVER	2	26.0	OFTEN	14
16	0	NEVER	NEVER	No	NEVER	533.203768103504	6.0	NEVER	715.046036359878	ZAN	FEMALE	39.8083	466.68276249529	NORTH 'A'	25	4	NEVER	8.0	OFTEN	NEVER	I have my own sitting place	A FEW MONTHS	NEVER	Zanzibar	2 YRS TT	...	11.4	BOY	RURAL	2.0	NORTH UNGUJA	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	A-LEVEL	SOMETIMES	4.0	25	4.0	✅	NEVER	NEVER	ALL THE TIME	NEVER	9	26.0	OFTEN	13
17	0	NEVER	NEVER	No	NEVER	533.203768103504	6.0	NEVER	715.046036359878	ZAN	FEMALE	39.8083	619.57305742806	NORTH 'A'	25	7	NEVER	8.0	OFTEN	NEVER	I have my own sitting place	A FEW MONTHS	NEVER	Zanzibar	2 YRS TT	...	11.4	GIRL	RURAL	3.0	NORTH UNGUJA	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	A-LEVEL	SOMETIMES	4.0	25	4.0	✅	NEVER	NEVER	ALL THE TIME	NEVER	5	26.0	OFTEN	13
18	0	NEVER	NEVER	No	NEVER	533.203768103504	7.0	NEVER	715.046036359878	ZAN	FEMALE	39.8083	523.813945692251	NORTH 'A'	25	5	NEVER	8.0	OFTEN	NEVER	I have my own sitting place	NEVER	NEVER	Zanzibar	2 YRS TT	...	11.4	GIRL	RURAL	2.0	NORTH UNGUJA	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	A-LEVEL	SOMETIMES	4.0	25	4.0	✅	NEVER	NEVER	ALL THE TIME	NEVER	4	26.0	OFTEN	12
19	0	NEVER	NEVER	No	NEVER	533.203768103504	8.0	NEVER	715.046036359878	ZAN	FEMALE	39.8083	619.57305742806	NORTH 'A'	25	7	NEVER	8.0	OFTEN	NEVER	I have my own sitting place	NEVER	NEVER	Zanzibar	2 YRS TT	...	11.4	GIRL	RURAL	3.0	NORTH UNGUJA	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	A-LEVEL	SOMETIMES	4.0	25	4.0	✅	NEVER	NEVER	ALL THE TIME	NEVER	6	26.0	OFTEN	12
20	0	NEVER	NEVER	No	NEVER	533.203768103504	8.0	NEVER	715.046036359878	ZAN	FEMALE	39.8083	607.460102059088	NORTH 'A'	25	6	NEVER	8.0	OFTEN	NEVER	I have my own sitting place	NEVER	NEVER	Zanzibar	2 YRS TT	...	11.4	BOY	RURAL	3.0	NORTH UNGUJA	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	A-LEVEL	SOMETIMES	4.0	25	4.0	✅	NEVER	NEVER	ALL THE TIME	NEVER	6	26.0	OFTEN	14
21	0	NEVER	NEVER	No	NEVER	538.154548741976	3.0	NEVER	601.83282358059	MOZ	MALE	36.792721	422.618310680605	Macomia	10577	3	NEVER	6.0	NEVER	NEVER	I have my own sitting place	NEVER	NEVER	Mozambique	3 YRS TT	...	1.2	BOY	LARGE CITY	1.0	Cabo Delgado	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	JUNIOR SEC	NEVER	0.0	23	4.0	✅	NEVER	NEVER	SOMETIMES	NEVER	0	38.0	NEVER	14
22	0	NEVER	NEVER	No	NEVER	538.154548741976	5.0	NEVER	648.090960225876	MOZ	MALE	36.792721	422.618310680605	Macomia	10577	3	NEVER	7.0	NEVER	NEVER	I have my own sitting place	NEVER	NEVER	Mozambique	3 YRS TT	...	1.2	BOY	LARGE CITY	3.0	Cabo Delgado	No homework/Never/Sometimes	TEMPORARY GOVT	SOMETIMES	NEVER	NEVER	JUNIOR SEC	NEVER	0.0	23	4.0	✅	NEVER	NEVER	SOMETIMES	NEVER	6	26.0	NEVER	14
23	0	NEVER	NEVER	No	NEVER	538.154548741976	7.0	NEVER	601.83282358059	MOZ	MALE	36.792721	453.902163917004	Macomia	10577	3	NEVER	6.0	NEVER	NEVER	I have my own sitting place	NEVER	NEVER	Mozambique	3 YRS TT	...	1.2	GIRL	LARGE CITY	3.0	Cabo Delgado	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	JUNIOR SEC	NEVER	0.0	23	4.0	❌	NEVER	NEVER	ALL THE TIME	NEVER	4	38.0	NEVER	15
24	0	NEVER	NEVER	No	NEVER	538.154548741976	7.0	NEVER	648.090960225876	MOZ	MALE	36.792721	433.300602029619	Macomia	10577	3	NEVER	7.0	NEVER	NEVER	I have my own sitting place	NEVER	NEVER	Mozambique	3 YRS TT	...	1.2	GIRL	LARGE CITY	3.0	Cabo Delgado	No homework/Never/Sometimes	TEMPORARY GOVT	SOMETIMES	NEVER	NEVER	JUNIOR SEC	NEVER	0.0	23	4.0	✅	NEVER	NEVER	SOMETIMES	NEVER	4	26.0	NEVER	11
25	0	NEVER	NEVER	No	NEVER	538.154548741976	8.0	NEVER	648.090960225876	MOZ	MALE	36.792721	514.180807957872	Macomia	10577	5	NEVER	7.0	NEVER	NEVER	I have my own sitting place	NEVER	NEVER	Mozambique	3 YRS TT	...	1.2	BOY	LARGE CITY	3.0	Cabo Delgado	Most of time/Always corrects	TEMPORARY GOVT	SOMETIMES	NEVER	NEVER	JUNIOR SEC	NEVER	0.0	23	4.0	✅	NEVER	NEVER	ALL THE TIME	NEVER	6	26.0	NEVER	11
26	0	NEVER	NEVER	No	NEVER	538.154548741976	10.0	NEVER	601.83282358059	MOZ	MALE	36.792721	514.180807957872	Macomia	10577	5	NEVER	6.0	NEVER	NEVER	I have my own sitting place	ONE YEAR	NEVER	Mozambique	3 YRS TT	...	1.2	GIRL	LARGE CITY	2.0	Cabo Delgado	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	JUNIOR SEC	NEVER	0.0	23	4.0	❌	NEVER	NEVER	SOMETIMES	NEVER	2	38.0	NEVER	16
27	0	NEVER	NEVER	No	NEVER	556.49494065268	2.0	NEVER	613.278135740248	MOZ	MALE	38.269127	555.383931732643	MaÃ¹a	70290	5	SOMETIMES	6.0	NEVER	SOMETIMES	I have my own sitting place	NEVER	NEVER	Mozambique	2 YRS TT	...	1.2	BOY	SMALLTOWN	2.0	Niassa	Most of time/Always corrects	TEMPORARY GOVT	SOMETIMES	SOMETIMES	NEVER	JUNIOR SEC	NEVER	2.0	7	4.0	❌	NEVER	NEVER	ALL THE TIME	NEVER	11	24.0	NEVER	15
28	0	NEVER	NEVER	No	NEVER	556.49494065268	3.0	NEVER	613.278135740248	MOZ	MALE	38.269127	494.15151167847	MaÃ¹a	70290	4	SOMETIMES	6.0	NEVER	SOMETIMES	I have my own sitting place	NEVER	NEVER	Mozambique	2 YRS TT	...	1.2	BOY	SMALLTOWN	3.0	Niassa	Most of time/Always corrects	TEMPORARY GOVT	SOMETIMES	SOMETIMES	NEVER	JUNIOR SEC	NEVER	2.0	7	4.0	❌	NEVER	NEVER	ALL THE TIME	NEVER	2	24.0	NEVER	15
29	0	NEVER	NEVER	No	NEVER	568.421821281727	6.0	SOMETIMES	715.332169163869	NAM	FEMALE	15.699697	473.168439385763	Ongwediva	8283	4	SOMETIMES	8.0	SOMETIMES	SOMETIMES	I have my own sitting place	TWO YEARS	NEVER	Namibia	3 YRS TT	...	9.6	BOY	RURAL	4.0	Oshana	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	TERTIARY ED	NEVER	1.0	25	4.0	❌	NEVER	NEVER	SOMETIMES	NEVER	1	43.0	SOMETIMES	12
30	0	NEVER	NEVER	No	NEVER	568.421821281727	6.0	SOMETIMES	715.332169163869	NAM	FEMALE	15.699697	398.773910347983	Ongwediva	8283	2	SOMETIMES	8.0	SOMETIMES	SOMETIMES	I have my own sitting place	A FEW MONTHS	NEVER	Namibia	3 YRS TT	...	9.6	GIRL	RURAL	2.0	Oshana	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	TERTIARY ED	NEVER	1.0	25	4.0	❌	NEVER	NEVER	NEVER	NEVER	7	43.0	SOMETIMES	12
31	0	NEVER	NEVER	No	NEVER	568.421821281727	7.0	SOMETIMES	715.332169163869	NAM	FEMALE	15.699697	516.183737585812	Ongwediva	8283	5	SOMETIMES	8.0	SOMETIMES	SOMETIMES	I have my own sitting place	THREE OR MORE YEARS	NEVER	Namibia	3 YRS TT	...	9.6	BOY	RURAL	3.0	Oshana	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	TERTIARY ED	NEVER	1.0	25	4.0	✅	NEVER	NEVER	SOMETIMES	NEVER	4	43.0	SOMETIMES	11
32	0	NEVER	NEVER	No	NEVER	568.421821281727	8.0	SOMETIMES	715.332169163869	NAM	FEMALE	15.699697	473.168439385763	Ongwediva	8283	4	SOMETIMES	8.0	SOMETIMES	SOMETIMES	I have my own sitting place	THREE OR MORE YEARS	NEVER	Namibia	3 YRS TT	...	9.6	BOY	RURAL	2.0	Oshana	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	TERTIARY ED	NEVER	1.0	25	4.0	❌	NEVER	NEVER	SOMETIMES	NEVER	1	43.0	SOMETIMES	12
33	0	NEVER	NEVER	No	NEVER	568.421821281727	8.0	SOMETIMES	715.332169163869	NAM	FEMALE	15.699697	437.40183888683	Ongwediva	8283	3	SOMETIMES	8.0	SOMETIMES	SOMETIMES	I have my own sitting place	TWO YEARS	NEVER	Namibia	3 YRS TT	...	9.6	GIRL	RURAL	3.0	Oshana	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	TERTIARY ED	NEVER	1.0	25	4.0	✅	NEVER	NEVER	SOMETIMES	NEVER	4	43.0	SOMETIMES	11
34	0	NEVER	NEVER	No	NEVER	568.421821281727	11.0	SOMETIMES	715.332169163869	NAM	FEMALE	15.699697	542.221822749035	Ongwediva	8283	5	SOMETIMES	8.0	SOMETIMES	SOMETIMES	I have my own sitting place	ONE YEAR	NEVER	Namibia	3 YRS TT	...	9.6	GIRL	RURAL	2.0	Oshana	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	TERTIARY ED	NEVER	1.0	25	4.0	✅	NEVER	NEVER	SOMETIMES	NEVER	8	43.0	SOMETIMES	11
35	0	NEVER	NEVER	No	NEVER	573.822672887333	[null]	NEVER	648.090960225876	MOZ	MALE	35.740688	411.84064173026	Marromeu	80506	2	NEVER	7.0	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Mozambique	2 YRS TT	...	7.4	GIRL	SMALLTOWN	1.0	Sofala	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	NEVER	1.0	16	4.0	✅	SOMETIMES	NEVER	ALL THE TIME	NEVER	0	50.0	NEVER	14
36	0	NEVER	NEVER	No	NEVER	573.822672887333	[null]	NEVER	648.090960225876	MOZ	MALE	35.740688	504.070782216841	Marromeu	80506	4	NEVER	7.0	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Mozambique	2 YRS TT	...	7.4	BOY	SMALLTOWN	4.0	Sofala	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	NEVER	1.0	16	4.0	❌	SOMETIMES	NEVER	ALL THE TIME	NEVER	0	50.0	NEVER	17
37	0	NEVER	NEVER	No	NEVER	573.822672887333	[null]	NEVER	648.090960225876	MOZ	MALE	35.740688	433.300602029619	Marromeu	80506	3	NEVER	7.0	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Mozambique	2 YRS TT	...	7.4	GIRL	SMALLTOWN	3.0	Sofala	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	NEVER	1.0	16	4.0	✅	SOMETIMES	NEVER	ALL THE TIME	NEVER	0	50.0	NEVER	12
38	0	NEVER	NEVER	No	NEVER	573.822672887333	[null]	NEVER	648.090960225876	MOZ	MALE	35.740688	524.290833698904	Marromeu	80506	5	NEVER	7.0	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Mozambique	2 YRS TT	...	7.4	GIRL	SMALLTOWN	3.0	Sofala	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	NEVER	1.0	16	4.0	✅	SOMETIMES	NEVER	ALL THE TIME	NEVER	0	50.0	NEVER	12
39	0	NEVER	NEVER	No	NEVER	573.822672887333	[null]	NEVER	648.090960225876	MOZ	MALE	35.740688	464.107567259366	Marromeu	80506	4	NEVER	7.0	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Mozambique	2 YRS TT	...	7.4	BOY	SMALLTOWN	2.0	Sofala	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	NEVER	1.0	16	4.0	❌	SOMETIMES	NEVER	SOMETIMES	NEVER	4	50.0	NEVER	17
40	0	NEVER	NEVER	No	NEVER	573.822672887333	4.0	NEVER	709.132625077388	MOZ	FEMALE	35.740688	433.300602029619	Marromeu	80506	3	NEVER	8.0	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Mozambique	2 YRS TT	...	7.4	GIRL	SMALLTOWN	[null]	Sofala	No homework/Never/Sometimes	TEMPORARY GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	NEVER	1.0	16	4.0	✅	SOMETIMES	NEVER	SOMETIMES	NEVER	7	29.0	NEVER	17
41	0	NEVER	NEVER	No	NEVER	584.624376098545	2.0	SOMETIMES	727.826634938163	NAM	MALE	14.627602	418.612451424724	Okongo	8238	3	NEVER	8.0	SOMETIMES	OFTEN	I have my own sitting place	ONE YEAR	NEVER	Namibia	3 YRS TT	...	48.2	GIRL	RURAL	2.0	Ohangwena	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	NEVER	SOMETIMES	SENIOR SEC	NEVER	0.0	23	4.0	✅	NEVER	NEVER	SOMETIMES	NEVER	6	29.0	SOMETIMES	12
42	0	NEVER	NEVER	No	NEVER	584.624376098545	2.0	SOMETIMES	727.826634938163	NAM	MALE	14.627602	542.221822749035	Okongo	8238	5	NEVER	8.0	SOMETIMES	OFTEN	I have my own sitting place	NEVER	NEVER	Namibia	3 YRS TT	...	48.2	BOY	RURAL	3.0	Ohangwena	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	SOMETIMES	SENIOR SEC	NEVER	0.0	23	4.0	✅	NEVER	NEVER	SOMETIMES	NEVER	5	29.0	SOMETIMES	14
43	0	NEVER	NEVER	No	NEVER	584.624376098545	4.0	SOMETIMES	767.599094692976	ZAM	FEMALE	32.753078	377.695460453945	CHOMA	1198	2	NEVER	8.0	SOMETIMES	NEVER	No place/share	NEVER	NEVER	Zambia	2 YRS TT	...	34.6	GIRL	RURAL	2.0	SOUTHERN	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	JUNIOR SEC	NEVER	1.0	20	4.0	✅	NEVER	NEVER	ALL THE TIME	NEVER	8	32.0	NEVER	13
44	0	NEVER	NEVER	No	NEVER	584.624376098545	4.0	SOMETIMES	727.826634938163	NAM	MALE	14.627602	377.695460453945	Okongo	8238	2	NEVER	8.0	SOMETIMES	OFTEN	I have my own sitting place	ONE YEAR	NEVER	Namibia	3 YRS TT	...	48.2	BOY	RURAL	2.0	Ohangwena	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	SOMETIMES	SENIOR SEC	NEVER	0.0	23	4.0	✅	NEVER	NEVER	SOMETIMES	NEVER	1	29.0	SOMETIMES	13
45	0	NEVER	NEVER	No	NEVER	584.624376098545	4.0	SOMETIMES	727.826634938163	NAM	MALE	14.627602	490.431785226581	Okongo	8238	4	NEVER	8.0	SOMETIMES	OFTEN	I have my own sitting place	ONE YEAR	NEVER	Namibia	3 YRS TT	...	48.2	BOY	RURAL	3.0	Ohangwena	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	NEVER	SOMETIMES	SENIOR SEC	NEVER	0.0	23	4.0	✅	NEVER	NEVER	SOMETIMES	NEVER	10	29.0	SOMETIMES	12
46	0	NEVER	NEVER	No	NEVER	584.624376098545	4.0	SOMETIMES	727.826634938163	NAM	MALE	14.627602	366.440903496948	Okongo	8238	1	NEVER	8.0	SOMETIMES	OFTEN	I have my own sitting place	TWO YEARS	NEVER	Namibia	3 YRS TT	...	48.2	BOY	RURAL	2.0	Ohangwena	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	SOMETIMES	SENIOR SEC	NEVER	0.0	23	4.0	✅	NEVER	NEVER	SOMETIMES	NEVER	5	29.0	SOMETIMES	12
47	0	NEVER	NEVER	No	NEVER	584.624376098545	4.0	SOMETIMES	727.826634938163	NAM	MALE	14.627602	428.150211557773	Okongo	8238	3	NEVER	8.0	SOMETIMES	OFTEN	I have my own sitting place	ONE YEAR	NEVER	Namibia	3 YRS TT	...	48.2	GIRL	RURAL	2.0	Ohangwena	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	SOMETIMES	SENIOR SEC	NEVER	0.0	23	4.0	✅	NEVER	NEVER	SOMETIMES	NEVER	7	29.0	SOMETIMES	12
48	0	NEVER	NEVER	No	NEVER	584.624376098545	5.0	SOMETIMES	727.826634938163	NAM	MALE	14.627602	446.558088614557	Okongo	8238	3	NEVER	8.0	SOMETIMES	OFTEN	I have my own sitting place	ONE YEAR	NEVER	Namibia	3 YRS TT	...	48.2	BOY	RURAL	2.0	Ohangwena	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	SOMETIMES	SENIOR SEC	NEVER	0.0	23	4.0	❌	NEVER	NEVER	SOMETIMES	NEVER	1	29.0	SOMETIMES	12
49	0	NEVER	NEVER	No	NEVER	584.624376098545	6.0	SOMETIMES	691.392391229917	NAM	MALE	19.364937	481.847801106837	Karibib	7379	4	NEVER	7.0	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Namibia	3 YRS TT	...	17.0	GIRL	RURAL	2.0	Erongo	No homework/Never/Sometimes	TEMPORARY GOVT	SOMETIMES	NEVER	NEVER	PRIMARY	NEVER	0.0	24	4.0	✅	NEVER	NEVER	SOMETIMES	NEVER	5	27.0	SOMETIMES	12
50	0	NEVER	NEVER	No	NEVER	584.624376098545	6.0	SOMETIMES	691.392391229917	NAM	MALE	19.364937	560.057434197836	Karibib	7379	5	NEVER	7.0	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Namibia	3 YRS TT	...	17.0	BOY	RURAL	4.0	Erongo	No homework/Never/Sometimes	TEMPORARY GOVT	SOMETIMES	NEVER	NEVER	PRIMARY	NEVER	0.0	24	4.0	✅	NEVER	NEVER	SOMETIMES	NEVER	3	27.0	SOMETIMES	12
51	0	NEVER	NEVER	No	NEVER	584.624376098545	6.0	SOMETIMES	691.392391229917	NAM	MALE	19.364937	366.440903496948	Karibib	7379	1	NEVER	7.0	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Namibia	3 YRS TT	...	17.0	BOY	RURAL	2.0	Erongo	No homework/Never/Sometimes	TEMPORARY GOVT	SOMETIMES	NEVER	NEVER	PRIMARY	NEVER	0.0	24	4.0	✅	NEVER	NEVER	SOMETIMES	NEVER	3	27.0	SOMETIMES	14
52	0	NEVER	NEVER	No	NEVER	584.624376098545	6.0	SOMETIMES	691.392391229917	NAM	MALE	19.364937	551.091939672771	Karibib	7379	5	NEVER	7.0	SOMETIMES	SOMETIMES	I have my own sitting place	TWO YEARS	NEVER	Namibia	3 YRS TT	...	17.0	GIRL	RURAL	3.0	Erongo	No homework/Never/Sometimes	TEMPORARY GOVT	SOMETIMES	NEVER	NEVER	PRIMARY	NEVER	0.0	24	4.0	✅	NEVER	NEVER	SOMETIMES	NEVER	11	27.0	SOMETIMES	11
53	0	NEVER	NEVER	No	NEVER	584.624376098545	6.0	SOMETIMES	691.392391229917	NAM	MALE	19.364937	618.237771009434	Karibib	7379	6	NEVER	7.0	SOMETIMES	SOMETIMES	I have my own sitting place	ONE YEAR	NEVER	Namibia	3 YRS TT	...	17.0	GIRL	RURAL	3.0	Erongo	No homework/Never/Sometimes	TEMPORARY GOVT	SOMETIMES	NEVER	NEVER	PRIMARY	NEVER	0.0	24	4.0	✅	NEVER	NEVER	SOMETIMES	NEVER	3	27.0	SOMETIMES	12
54	0	NEVER	NEVER	No	NEVER	584.624376098545	6.0	SOMETIMES	691.392391229917	NAM	MALE	19.364937	652.287574684417	Karibib	7379	7	NEVER	7.0	SOMETIMES	SOMETIMES	I have my own sitting place	TWO YEARS	NEVER	Namibia	3 YRS TT	...	17.0	BOY	RURAL	5.0	Erongo	No homework/Never/Sometimes	TEMPORARY GOVT	SOMETIMES	NEVER	NEVER	PRIMARY	NEVER	0.0	24	4.0	✅	NEVER	NEVER	SOMETIMES	NEVER	4	27.0	SOMETIMES	12
55	0	NEVER	NEVER	No	NEVER	584.624376098545	6.0	SOMETIMES	727.826634938163	NAM	MALE	14.627602	455.523583139623	Okongo	8238	3	NEVER	8.0	SOMETIMES	OFTEN	I have my own sitting place	NEVER	NEVER	Namibia	3 YRS TT	...	48.2	BOY	RURAL	4.0	Ohangwena	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	SOMETIMES	SENIOR SEC	NEVER	0.0	23	4.0	❌	NEVER	NEVER	SOMETIMES	NEVER	3	29.0	SOMETIMES	18
56	0	NEVER	NEVER	No	NEVER	584.624376098545	6.0	SOMETIMES	691.392391229917	NAM	MALE	19.364937	524.863099306887	Karibib	7379	5	NEVER	7.0	SOMETIMES	SOMETIMES	I have my own sitting place	ONE YEAR	NEVER	Namibia	3 YRS TT	...	17.0	GIRL	RURAL	2.0	Erongo	No homework/Never/Sometimes	TEMPORARY GOVT	SOMETIMES	NEVER	NEVER	PRIMARY	NEVER	0.0	24	4.0	✅	NEVER	NEVER	SOMETIMES	NEVER	5	27.0	SOMETIMES	12
57	0	NEVER	NEVER	No	NEVER	584.624376098545	6.0	SOMETIMES	691.392391229917	NAM	MALE	19.364937	629.015439959779	Karibib	7379	7	NEVER	7.0	SOMETIMES	SOMETIMES	I have my own sitting place	ONE YEAR	NEVER	Namibia	3 YRS TT	...	17.0	GIRL	RURAL	4.0	Erongo	No homework/Never/Sometimes	TEMPORARY GOVT	SOMETIMES	NEVER	NEVER	PRIMARY	NEVER	0.0	24	4.0	❌	NEVER	NEVER	SOMETIMES	NEVER	6	27.0	SOMETIMES	12
58	0	NEVER	NEVER	No	NEVER	584.624376098545	6.0	SOMETIMES	691.392391229917	NAM	MALE	19.364937	640.365374518107	Karibib	7379	7	NEVER	7.0	SOMETIMES	SOMETIMES	I have my own sitting place	TWO YEARS	NEVER	Namibia	3 YRS TT	...	17.0	BOY	RURAL	5.0	Erongo	No homework/Never/Sometimes	TEMPORARY GOVT	SOMETIMES	NEVER	NEVER	PRIMARY	NEVER	0.0	24	4.0	✅	NEVER	NEVER	SOMETIMES	NEVER	6	27.0	SOMETIMES	12
59	0	NEVER	NEVER	No	NEVER	584.624376098545	6.0	SOMETIMES	691.392391229917	NAM	MALE	19.364937	437.40183888683	Karibib	7379	3	NEVER	7.0	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Namibia	3 YRS TT	...	17.0	BOY	RURAL	2.0	Erongo	No homework/Never/Sometimes	TEMPORARY GOVT	SOMETIMES	NEVER	NEVER	PRIMARY	NEVER	0.0	24	4.0	✅	NEVER	NEVER	SOMETIMES	NEVER	5	27.0	SOMETIMES	12
60	0	NEVER	NEVER	No	NEVER	584.624376098545	6.0	SOMETIMES	691.392391229917	NAM	MALE	19.364937	560.057434197836	Karibib	7379	5	NEVER	7.0	SOMETIMES	SOMETIMES	I have my own sitting place	ONE YEAR	NEVER	Namibia	3 YRS TT	...	17.0	GIRL	RURAL	3.0	Erongo	No homework/Never/Sometimes	TEMPORARY GOVT	SOMETIMES	NEVER	NEVER	PRIMARY	NEVER	0.0	24	4.0	✅	NEVER	NEVER	SOMETIMES	NEVER	10	27.0	SOMETIMES	11
61	0	NEVER	NEVER	No	NEVER	584.624376098545	7.0	SOMETIMES	691.392391229917	NAM	MALE	19.364937	516.183737585812	Karibib	7379	5	NEVER	7.0	SOMETIMES	SOMETIMES	I have my own sitting place	A FEW MONTHS	NEVER	Namibia	3 YRS TT	...	17.0	GIRL	RURAL	3.0	Erongo	No homework/Never/Sometimes	TEMPORARY GOVT	SOMETIMES	NEVER	NEVER	PRIMARY	NEVER	0.0	24	4.0	✅	NEVER	NEVER	SOMETIMES	NEVER	3	27.0	SOMETIMES	12
62	0	NEVER	NEVER	No	NEVER	584.624376098545	7.0	SOMETIMES	767.599094692976	ZAM	FEMALE	32.753078	473.168439385763	CHOMA	1198	4	NEVER	8.0	SOMETIMES	NEVER	No place/share	ONE YEAR	NEVER	Zambia	2 YRS TT	...	34.6	BOY	RURAL	2.0	SOUTHERN	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	JUNIOR SEC	NEVER	1.0	20	4.0	✅	NEVER	NEVER	SOMETIMES	NEVER	6	32.0	NEVER	11
63	0	NEVER	NEVER	No	NEVER	584.624376098545	8.0	SOMETIMES	727.826634938163	NAM	MALE	14.627602	388.47312940429	Okongo	8238	2	NEVER	8.0	SOMETIMES	OFTEN	I have my own sitting place	ONE YEAR	NEVER	Namibia	3 YRS TT	...	48.2	BOY	RURAL	2.0	Ohangwena	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	NEVER	SOMETIMES	SENIOR SEC	NEVER	0.0	23	4.0	✅	NEVER	NEVER	SOMETIMES	NEVER	11	29.0	SOMETIMES	13
64	0	NEVER	NEVER	No	NEVER	584.624376098545	8.0	SOMETIMES	767.599094692976	ZAM	FEMALE	32.753078	388.47312940429	CHOMA	1198	2	NEVER	8.0	SOMETIMES	NEVER	No place/share	NEVER	NEVER	Zambia	2 YRS TT	...	34.6	GIRL	RURAL	2.0	SOUTHERN	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	JUNIOR SEC	NEVER	1.0	20	4.0	❌	NEVER	NEVER	SOMETIMES	NEVER	5	32.0	NEVER	11
65	0	NEVER	NEVER	No	NEVER	584.624376098545	9.0	SOMETIMES	691.392391229917	NAM	MALE	19.364937	490.431785226581	Karibib	7379	4	NEVER	7.0	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Namibia	3 YRS TT	...	17.0	GIRL	RURAL	3.0	Erongo	No homework/Never/Sometimes	TEMPORARY GOVT	SOMETIMES	NEVER	NEVER	PRIMARY	NEVER	0.0	24	4.0	✅	NEVER	NEVER	SOMETIMES	NEVER	4	27.0	SOMETIMES	13
66	0	NEVER	NEVER	No	NEVER	584.624376098545	9.0	SOMETIMES	691.392391229917	NAM	MALE	19.364937	516.183737585812	Karibib	7379	5	NEVER	7.0	SOMETIMES	SOMETIMES	I have my own sitting place	ONE YEAR	NEVER	Namibia	3 YRS TT	...	17.0	GIRL	RURAL	2.0	Erongo	No homework/Never/Sometimes	TEMPORARY GOVT	SOMETIMES	NEVER	NEVER	PRIMARY	NEVER	0.0	24	4.0	✅	NEVER	NEVER	SOMETIMES	NEVER	7	27.0	SOMETIMES	12
67	0	NEVER	NEVER	No	NEVER	584.624376098545	9.0	SOMETIMES	691.392391229917	NAM	MALE	19.364937	542.221822749035	Karibib	7379	5	NEVER	7.0	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Namibia	3 YRS TT	...	17.0	BOY	RURAL	2.0	Erongo	No homework/Never/Sometimes	TEMPORARY GOVT	SOMETIMES	NEVER	NEVER	PRIMARY	NEVER	0.0	24	4.0	✅	NEVER	NEVER	SOMETIMES	NEVER	2	27.0	SOMETIMES	11
68	0	NEVER	NEVER	No	NEVER	584.624376098545	10.0	SOMETIMES	691.392391229917	NAM	MALE	19.364937	533.542461027961	Karibib	7379	5	NEVER	7.0	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Namibia	3 YRS TT	...	17.0	GIRL	RURAL	3.0	Erongo	No homework/Never/Sometimes	TEMPORARY GOVT	SOMETIMES	NEVER	NEVER	PRIMARY	NEVER	0.0	24	4.0	❌	NEVER	NEVER	NEVER	NEVER	0	27.0	SOMETIMES	12
69	0	NEVER	NEVER	No	NEVER	584.624376098545	13.0	SOMETIMES	781.810357291219	SOU	MALE	30.978416	607.84161246441	KZ	500117771	6	SOMETIMES	8.0	SOMETIMES	SOMETIMES	I have my own sitting place	TWO YEARS	NEVER	South Africa	3 YRS TT	...	3.0	GIRL	LARGE CITY	3.0	UMLAZI	Most of time/Always corrects	TEMPORARY GOVT	SOMETIMES	NEVER	NEVER	A-LEVEL	NEVER	0.0	21	4.0	✅	NEVER	SOMETIMES	MOST OF THE TIME	NEVER	6	40.0	SOMETIMES	12
70	0	NEVER	NEVER	No	NEVER	584.624376098545	14.0	SOMETIMES	691.392391229917	SOU	FEMALE	30.978416	693.109188053866	KZ	500117771	7	SOMETIMES	7.0	SOMETIMES	SOMETIMES	I have my own sitting place	THREE OR MORE YEARS	NEVER	South Africa	>3 YRS TT	...	3.0	GIRL	LARGE CITY	4.0	UMLAZI	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	A-LEVEL	NEVER	0.0	21	4.0	✅	NEVER	SOMETIMES	ALL THE TIME	NEVER	1	36.0	SOMETIMES	11
71	0	NEVER	NEVER	No	NEVER	584.624376098545	14.0	SOMETIMES	781.810357291219	SOU	MALE	30.978416	490.431785226581	KZ	500117771	4	SOMETIMES	8.0	SOMETIMES	SOMETIMES	I have my own sitting place	TWO YEARS	NEVER	South Africa	3 YRS TT	...	3.0	GIRL	LARGE CITY	2.0	UMLAZI	Most of time/Always corrects	TEMPORARY GOVT	SOMETIMES	NEVER	NEVER	A-LEVEL	NEVER	0.0	21	4.0	✅	NEVER	SOMETIMES	SOMETIMES	NEVER	0	40.0	SOMETIMES	13
72	0	NEVER	NEVER	No	NEVER	600.039306722879	2.0	SOMETIMES	668.40638930927	UGA	MALE	33.486534	473.168439385763	Sironko	9062	4	OFTEN	7.0	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Uganda	2 YRS TT	...	35.4	GIRL	RURAL	4.0	Eastern	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	SENIOR SEC	SOMETIMES	2.0	20	5.0	✅	NEVER	NEVER	MOST OF THE TIME	SOMETIMES	7	34.0	SOMETIMES	16
73	0	NEVER	NEVER	No	NEVER	600.039306722879	2.0	SOMETIMES	668.40638930927	UGA	MALE	33.486534	428.150211557773	Sironko	9062	3	OFTEN	7.0	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Uganda	2 YRS TT	...	35.4	BOY	RURAL	4.0	Eastern	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	SENIOR SEC	SOMETIMES	2.0	20	5.0	✅	NEVER	NEVER	SOMETIMES	SOMETIMES	8	34.0	SOMETIMES	17
74	0	NEVER	NEVER	No	NEVER	600.039306722879	2.0	SOMETIMES	635.405739248921	ZAM	MALE	28.651711	377.695460453945	MUFULIRA	217	2	NEVER	7.0	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Zambia	NO TT	...	30.4	GIRL	RURAL	1.0	COPPERBELT	Most of time/Always corrects	TEMPORARY NON-GOVT	SOMETIMES	NEVER	SOMETIMES	SENIOR SEC	NEVER	24.0	13	5.0	✅	SOMETIMES	NEVER	NEVER	NEVER	6	21.0	SOMETIMES	13
75	0	NEVER	NEVER	No	NEVER	600.039306722879	3.0	NEVER	691.392391229917	NAM	FEMALE	24.283434	560.057434197836	Moses Garoeb	7089	5	SOMETIMES	7.0	OFTEN	OFTEN	I have my own sitting place	ONE YEAR	NEVER	Namibia	3 YRS TT	...	122.8	GIRL	LARGE CITY	3.0	Khomas	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	SOMETIMES	3.0	49	5.0	✅	SOMETIMES	NEVER	SOMETIMES	SOMETIMES	5	45.0	SOMETIMES	12
76	0	NEVER	NEVER	No	NEVER	600.039306722879	3.0	OFTEN	691.392391229917	MAL	FEMALE	34.801693	428.150211557773	Rumphi	500470	3	NEVER	7.0	OFTEN	OFTEN	No place/share	ONE YEAR	NEVER	Malawi	2 YRS TT	...	12.4	BOY	SMALLTOWN	3.0	Central western	No homework/Never/Sometimes	PERMANENT GOVT	OFTEN	OFTEN	SOMETIMES	SENIOR SEC	SOMETIMES	7.0	20	5.0	✅	NEVER	NEVER	SOMETIMES	SOMETIMES	5	32.0	OFTEN	15
77	0	NEVER	NEVER	No	NEVER	600.039306722879	5.0	OFTEN	691.392391229917	MAL	FEMALE	34.801693	437.40183888683	Rumphi	500470	3	NEVER	7.0	OFTEN	OFTEN	No place/share	TWO YEARS	NEVER	Malawi	2 YRS TT	...	12.4	GIRL	SMALLTOWN	2.0	Central western	No homework/Never/Sometimes	PERMANENT GOVT	OFTEN	OFTEN	SOMETIMES	SENIOR SEC	SOMETIMES	7.0	20	5.0	❌	NEVER	NEVER	NEVER	SOMETIMES	2	32.0	OFTEN	12
78	0	NEVER	NEVER	No	NEVER	600.039306722879	5.0	SOMETIMES	703.219213794897	MAL	MALE	33.924824	342.405747961665	Mchinji	502877	1	NEVER	8.0	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Malawi	NO TT	...	1.8	BOY	RURAL	2.0	Northern	No homework/Never/Sometimes	TEMPORARY NON-GOVT	SOMETIMES	SOMETIMES	SOMETIMES	SENIOR SEC	NEVER	6.0	21	5.0	✅	NEVER	NEVER	MOST OF THE TIME	NEVER	3	22.0	SOMETIMES	14
79	0	NEVER	NEVER	No	NEVER	600.039306722879	6.0	NEVER	679.756323867598	NAM	FEMALE	15.132598	481.847801106837	Ohangwena	8247	4	NEVER	7.0	NEVER	NEVER	I have my own sitting place	NEVER	NEVER	Namibia	3 YRS TT	...	9.6	GIRL	RURAL	1.0	Ohangwena	No homework/Never/Sometimes	PERMANENT GOVT	NEVER	NEVER	NEVER	PRIMARY	NEVER	0.0	22	5.0	✅	NEVER	NEVER	SOMETIMES	NEVER	4	29.0	NEVER	12
80	0	NEVER	NEVER	No	NEVER	600.039306722879	6.0	NEVER	691.392391229917	NAM	FEMALE	24.283434	524.863099306887	Moses Garoeb	7089	5	SOMETIMES	7.0	OFTEN	OFTEN	I have my own sitting place	ONE YEAR	NEVER	Namibia	3 YRS TT	...	122.8	BOY	LARGE CITY	3.0	Khomas	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	SOMETIMES	3.0	49	5.0	❌	SOMETIMES	NEVER	SOMETIMES	SOMETIMES	3	45.0	SOMETIMES	12
81	0	NEVER	NEVER	No	NEVER	600.039306722879	6.0	SOMETIMES	646.278785800597	ZAM	FEMALE	23.104891	464.393700063358	ZAMBEZI	3696	4	NEVER	7.0	NEVER	SOMETIMES	No place/share	NEVER	NEVER	Zambia	2 YRS TT	...	1.4	BOY	SMALLTOWN	2.0	NORTH WESTERN	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	SENIOR SEC	NEVER	1.0	18	5.0	✅	NEVER	NEVER	SOMETIMES	NEVER	7	30.0	SOMETIMES	13
82	0	NEVER	NEVER	No	NEVER	600.039306722879	7.0	NEVER	691.392391229917	NAM	FEMALE	24.283434	629.015439959779	Moses Garoeb	7089	7	SOMETIMES	7.0	OFTEN	OFTEN	I have my own sitting place	THREE OR MORE YEARS	NEVER	Namibia	3 YRS TT	...	122.8	BOY	LARGE CITY	4.0	Khomas	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	SOMETIMES	3.0	49	5.0	✅	SOMETIMES	NEVER	SOMETIMES	SOMETIMES	0	45.0	SOMETIMES	12
83	0	NEVER	NEVER	No	NEVER	600.039306722879	7.0	NEVER	691.392391229917	NAM	FEMALE	24.283434	607.84161246441	Moses Garoeb	7089	6	SOMETIMES	7.0	OFTEN	OFTEN	I have my own sitting place	THREE OR MORE YEARS	NEVER	Namibia	3 YRS TT	...	122.8	BOY	LARGE CITY	3.0	Khomas	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	SOMETIMES	3.0	49	5.0	✅	SOMETIMES	NEVER	SOMETIMES	SOMETIMES	1	45.0	SOMETIMES	12
84	0	NEVER	NEVER	No	NEVER	600.039306722879	7.0	NEVER	691.392391229917	NAM	FEMALE	24.283434	507.599753466068	Moses Garoeb	7089	4	SOMETIMES	7.0	OFTEN	OFTEN	I have my own sitting place	A FEW MONTHS	NEVER	Namibia	3 YRS TT	...	122.8	BOY	LARGE CITY	4.0	Khomas	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	SOMETIMES	3.0	49	5.0	✅	SOMETIMES	NEVER	MOST OF THE TIME	SOMETIMES	3	45.0	SOMETIMES	11
85	0	NEVER	NEVER	No	NEVER	600.039306722879	7.0	NEVER	691.392391229917	NAM	FEMALE	24.283434	569.118306324233	Moses Garoeb	7089	6	SOMETIMES	7.0	OFTEN	OFTEN	I have my own sitting place	TWO YEARS	NEVER	Namibia	3 YRS TT	...	122.8	GIRL	LARGE CITY	4.0	Khomas	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	SOMETIMES	3.0	49	5.0	✅	SOMETIMES	NEVER	SOMETIMES	SOMETIMES	4	45.0	SOMETIMES	12
86	0	NEVER	NEVER	No	NEVER	600.039306722879	7.0	NEVER	691.392391229917	NAM	FEMALE	24.283434	578.46531125462	Moses Garoeb	7089	6	SOMETIMES	7.0	OFTEN	OFTEN	I have my own sitting place	ONE YEAR	NEVER	Namibia	3 YRS TT	...	122.8	GIRL	LARGE CITY	4.0	Khomas	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	SOMETIMES	3.0	49	5.0	✅	SOMETIMES	NEVER	NEVER	SOMETIMES	1	45.0	SOMETIMES	13
87	0	NEVER	NEVER	No	NEVER	600.039306722879	7.0	OFTEN	691.392391229917	MAL	FEMALE	34.801693	455.523583139623	Rumphi	500470	3	NEVER	7.0	OFTEN	OFTEN	No place/share	TWO YEARS	NEVER	Malawi	2 YRS TT	...	12.4	GIRL	SMALLTOWN	2.0	Central western	No homework/Never/Sometimes	PERMANENT GOVT	OFTEN	OFTEN	SOMETIMES	SENIOR SEC	SOMETIMES	7.0	20	5.0	✅	NEVER	NEVER	SOMETIMES	SOMETIMES	5	32.0	OFTEN	11
88	0	NEVER	NEVER	No	NEVER	600.039306722879	7.0	SOMETIMES	635.405739248921	ZAM	MALE	28.651711	354.709458533298	MUFULIRA	217	1	NEVER	7.0	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Zambia	NO TT	...	30.4	GIRL	RURAL	1.0	COPPERBELT	No homework/Never/Sometimes	TEMPORARY NON-GOVT	SOMETIMES	NEVER	SOMETIMES	SENIOR SEC	NEVER	24.0	13	5.0	✅	SOMETIMES	NEVER	SOMETIMES	NEVER	4	21.0	SOMETIMES	13
89	0	NEVER	NEVER	No	NEVER	600.039306722879	8.0	NEVER	691.392391229917	NAM	FEMALE	24.283434	569.118306324233	Moses Garoeb	7089	6	SOMETIMES	7.0	OFTEN	OFTEN	I have my own sitting place	ONE YEAR	NEVER	Namibia	3 YRS TT	...	122.8	GIRL	LARGE CITY	2.0	Khomas	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	SOMETIMES	3.0	49	5.0	✅	SOMETIMES	NEVER	SOMETIMES	SOMETIMES	7	45.0	SOMETIMES	11
90	0	NEVER	NEVER	No	NEVER	600.039306722879	8.0	NEVER	691.392391229917	NAM	FEMALE	24.283434	507.599753466068	Moses Garoeb	7089	4	SOMETIMES	7.0	OFTEN	OFTEN	I have my own sitting place	ONE YEAR	NEVER	Namibia	3 YRS TT	...	122.8	GIRL	LARGE CITY	2.0	Khomas	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	SOMETIMES	3.0	49	5.0	✅	SOMETIMES	NEVER	MOST OF THE TIME	SOMETIMES	3	45.0	SOMETIMES	12
91	0	NEVER	NEVER	No	NEVER	600.039306722879	8.0	NEVER	691.392391229917	NAM	FEMALE	24.283434	588.003071387669	Moses Garoeb	7089	6	SOMETIMES	7.0	OFTEN	OFTEN	I have my own sitting place	THREE OR MORE YEARS	NEVER	Namibia	3 YRS TT	...	122.8	BOY	LARGE CITY	3.0	Khomas	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	SOMETIMES	3.0	49	5.0	✅	SOMETIMES	NEVER	SOMETIMES	SOMETIMES	2	45.0	SOMETIMES	12
92	0	NEVER	NEVER	No	NEVER	600.039306722879	9.0	SOMETIMES	703.219213794897	MAL	MALE	33.924824	377.695460453945	Mchinji	502877	2	NEVER	8.0	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Malawi	NO TT	...	1.8	GIRL	RURAL	2.0	Northern	No homework/Never/Sometimes	TEMPORARY NON-GOVT	SOMETIMES	SOMETIMES	SOMETIMES	SENIOR SEC	NEVER	6.0	21	5.0	✅	NEVER	NEVER	SOMETIMES	NEVER	12	22.0	SOMETIMES	15
93	0	NEVER	NEVER	No	NEVER	600.039306722879	9.0	SOMETIMES	646.278785800597	ZAM	FEMALE	23.104891	398.773910347983	ZAMBEZI	3696	2	NEVER	7.0	NEVER	SOMETIMES	I have my own sitting place	NEVER	NEVER	Zambia	2 YRS TT	...	1.4	GIRL	SMALLTOWN	2.0	NORTH WESTERN	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	SENIOR SEC	NEVER	1.0	18	5.0	✅	NEVER	NEVER	SOMETIMES	NEVER	7	30.0	SOMETIMES	12
94	0	NEVER	NEVER	No	NEVER	600.039306722879	10.0	NEVER	691.392391229917	NAM	FEMALE	24.283434	588.003071387669	Moses Garoeb	7089	6	SOMETIMES	7.0	OFTEN	OFTEN	I have my own sitting place	THREE OR MORE YEARS	NEVER	Namibia	3 YRS TT	...	122.8	GIRL	LARGE CITY	3.0	Khomas	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	SOMETIMES	3.0	49	5.0	✅	SOMETIMES	NEVER	SOMETIMES	SOMETIMES	2	45.0	SOMETIMES	12
95	0	NEVER	NEVER	No	NEVER	600.039306722879	10.0	NEVER	691.392391229917	NAM	FEMALE	24.283434	588.003071387669	Moses Garoeb	7089	6	SOMETIMES	7.0	OFTEN	OFTEN	I have my own sitting place	A FEW MONTHS	NEVER	Namibia	3 YRS TT	...	122.8	BOY	LARGE CITY	3.0	Khomas	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	SOMETIMES	3.0	49	5.0	✅	SOMETIMES	NEVER	SOMETIMES	SOMETIMES	2	45.0	SOMETIMES	12
96	0	NEVER	NEVER	No	NEVER	600.039306722879	10.0	NEVER	691.392391229917	NAM	FEMALE	24.283434	629.015439959779	Moses Garoeb	7089	7	SOMETIMES	7.0	OFTEN	OFTEN	I have my own sitting place	ONE YEAR	NEVER	Namibia	3 YRS TT	...	122.8	GIRL	LARGE CITY	4.0	Khomas	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	SOMETIMES	3.0	49	5.0	✅	SOMETIMES	NEVER	SOMETIMES	SOMETIMES	5	45.0	SOMETIMES	13
97	0	NEVER	NEVER	No	NEVER	600.039306722879	10.0	NEVER	691.392391229917	NAM	FEMALE	24.283434	618.237771009434	Moses Garoeb	7089	6	SOMETIMES	7.0	OFTEN	OFTEN	I have my own sitting place	TWO YEARS	NEVER	Namibia	3 YRS TT	...	122.8	GIRL	LARGE CITY	4.0	Khomas	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	SOMETIMES	3.0	49	5.0	❌	SOMETIMES	NEVER	SOMETIMES	SOMETIMES	6	45.0	SOMETIMES	13
98	0	NEVER	NEVER	No	NEVER	600.039306722879	10.0	OFTEN	691.392391229917	MAL	FEMALE	34.801693	428.150211557773	Rumphi	500470	3	NEVER	7.0	OFTEN	OFTEN	No place/share	THREE OR MORE YEARS	NEVER	Malawi	2 YRS TT	...	12.4	BOY	SMALLTOWN	3.0	Central western	No homework/Never/Sometimes	PERMANENT GOVT	OFTEN	OFTEN	SOMETIMES	SENIOR SEC	SOMETIMES	7.0	20	5.0	✅	NEVER	NEVER	NEVER	SOMETIMES	5	32.0	OFTEN	14
99	0	NEVER	NEVER	No	NEVER	600.039306722879	11.0	NEVER	691.392391229917	NAM	FEMALE	24.283434	437.40183888683	Moses Garoeb	7089	3	SOMETIMES	7.0	OFTEN	OFTEN	I have my own sitting place	THREE OR MORE YEARS	NEVER	Namibia	3 YRS TT	...	122.8	GIRL	LARGE CITY	3.0	Khomas	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	SOMETIMES	3.0	49	5.0	✅	SOMETIMES	NEVER	SOMETIMES	SOMETIMES	2	45.0	SOMETIMES	13
100	0	NEVER	NEVER	No	NEVER	600.039306722879	12.0	NEVER	691.392391229917	NAM	FEMALE	24.283434	629.015439959779	Moses Garoeb	7089	7	SOMETIMES	7.0	OFTEN	OFTEN	I have my own sitting place	ONE YEAR	NEVER	Namibia	3 YRS TT	...	122.8	BOY	LARGE CITY	4.0	Khomas	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	SOMETIMES	3.0	49	5.0	✅	SOMETIMES	NEVER	SOMETIMES	SOMETIMES	4	45.0	SOMETIMES	12

Rows: 1-100 | Columns: 66

Data Exploration and Preparation¶

Let's look at the links between all the variables. Remember our goal: find a way to predict students' final scores (zralocp & zmalocp).

In [4]:

%matplotlib inline
africa.corr()

Out[4]:

	"PABSENT"	"zmaloct"	"zpses"	"zraloct"	"lon"	"zralocp"	"SCHOOL"	"ZRALEVP"	"ZRALEVT"	"lat"	"PUPIL"	"PMALIVE"	"zmalocp"	"XNUMYRS"	"zsdist"	"ZMALEVP"	"SINS2006"	"numstu"	"ZMALEVT"	"PFALIVE"	"zpsibs"	"XAGE"	"PAGE"
"PABSENT"	1.0	0.000634768216701476	-0.159857588214997	-0.0452626194354515	0.0927943249222189	-0.119063512400356	-0.0745845594217657	-0.12137594592758	-0.0247310210154747	0.149327898736702	0.0137840751966684	0.000446624348548854	-0.0935747342264917	-0.0433124368850064	0.0304561818550502	-0.0905033898778264	0.0215932316350323	-0.0211938151563663	-0.00547253953239791	-0.00110376944125852	0.0671436122410694	-0.0509819733546793	0.109461854921518
"zmaloct"	0.000634768216701476	1.0	0.0642431793210715	0.34536706841214	0.084483876569471	0.218880984601565	0.132213900026219	0.209556315349468	0.251993320684569	0.210049053109292	0.0283412076522454	0.0305500167965357	0.250965886166486	0.0051282003410214	-0.0277078322096959	0.250877326629872	0.0155105256128017	0.0720292202024169	0.872384090645248	0.0265895175967823	0.00367760827975287	-0.00869879675197664	-0.0608468063017805
"zpses"	-0.159857588214997	0.0642431793210715	1.0	0.2298174221299	0.103673572787674	0.402352485399678	0.116230360181866	0.384816426283178	0.12054983531054	-0.295771161199273	0.10366866392448	0.0621825483438527	0.351211428637203	0.209194134452711	-0.252539248640695	0.349666367786342	0.106151036960665	0.238100393109102	0.0541322474965005	0.101990660668278	-0.282273630374943	0.201449775767261	-0.45127610426051
"zraloct"	-0.0452626194354515	0.34536706841214	0.2298174221299	1.0	0.00511286889343384	0.179696463805134	0.149162601601017	0.164782212351045	0.72285254176971	-0.0422740253845476	0.0988894039923157	0.0118439135101419	0.197058944032952	-0.00113133485575159	-0.00300828808166533	0.199958806848278	-0.0175576715391245	0.17861964657897	0.330522422441687	0.0118858580622151	-0.0768685388397108	-0.0116822606232017	-0.160649877538886
"lon"	0.0927943249222189	0.084483876569471	0.103673572787674	0.00511286889343384	1.0	0.176652529058698	-0.01816010532087	0.16617338148148	-0.0481835899560288	0.332423303644832	0.189929402427363	0.115228385396968	0.284355725532703	0.110727716137827	-0.197056693384095	0.282791561285406	0.356808990635777	0.292656468016612	0.0761703761894066	0.121797767126875	-0.0921437917560176	0.0229928660486551	-0.18224819890896
"zralocp"	-0.119063512400356	0.218880984601565	0.402352485399678	0.179696463805134	0.176652529058698	1.0	0.00174602957153825	0.976568832035258	0.0822179369077413	0.0571608069632668	0.00934756041608331	0.0852535842856993	0.741112179159034	0.100095387104534	-0.155982477810229	0.733921345431609	0.0759885541863012	0.127003228880236	0.202551801551403	0.0836016407442337	-0.168440177078353	0.0646324206317302	-0.2564645128436
"SCHOOL"	-0.0745845594217657	0.132213900026219	0.116230360181866	0.149162601601017	-0.01816010532087	0.00174602957153825	1.0	-0.00273105068334987	0.100897148839531	0.0438742581029709	-0.037118828992	-0.00616070417164962	0.0453405165629102	0.11882299037684	-0.0531145356156115	0.0487202967761977	0.000193330440392355	-0.0272685551887227	0.0696439050209671	0.0021296498444582	-0.0013051773420848	0.135485007065018	-0.042006278499272
"ZRALEVP"	-0.12137594592758	0.209556315349468	0.384816426283178	0.164782212351045	0.16617338148148	0.976568832035258	-0.00273105068334987	1.0	0.0756604377633032	0.0605518703240999	0.00819810179047645	0.0819184363674626	0.714623834663774	0.0931213566146653	-0.150986849920418	0.705562127393942	0.0674431569272217	0.117494370360593	0.195262694767212	0.0782027294108056	-0.159438109675078	0.0576254598163014	-0.246419934792913
"ZRALEVT"	-0.0247310210154747	0.251993320684569	0.12054983531054	0.72285254176971	-0.0481835899560288	0.0822179369077413	0.100897148839531	0.0756604377633032	1.0	-0.0388594891912603	0.0420332015484502	-0.000843659734207962	0.103697161163614	0.00759862277113247	0.0147005522689167	0.104273173708756	0.00612080736699575	0.0876821920885674	0.265809385638639	-0.00675589251744402	-0.0349990883065118	0.00568762055729109	-0.0873264432910471
"lat"	0.149327898736702	0.210049053109292	-0.295771161199273	-0.0422740253845476	0.332423303644832	0.0571608069632668	0.0438742581029709	0.0605518703240999	-0.0388594891912603	1.0	0.0800162975516716	0.081561090882777	0.0375604147443511	-0.143043183221223	-0.0421269210905451	0.0384976843653409	0.0212825456712645	0.0796499445331421	0.1775653775201	0.0862071416858673	0.232349860416331	-0.217506310923711	0.172200329614825
"PUPIL"	0.0137840751966684	0.0283412076522454	0.10366866392448	0.0988894039923157	0.189929402427363	0.00934756041608331	-0.037118828992	0.00819810179047645	0.0420332015484502	0.0800162975516716	1.0	0.0246324770717143	-0.00394101139475663	0.0227989678130104	-0.0547143513663696	-0.00537851598728793	-0.00497845769255448	0.557620436953908	0.0429320293177747	0.0298955546988465	-0.0576098548154418	-0.00701510089461803	-0.0786883312963944
"PMALIVE"	0.000446624348548854	0.0305500167965357	0.0621825483438527	0.0118439135101419	0.115228385396968	0.0852535842856993	-0.00616070417164962	0.0819184363674626	-0.000843659734207962	0.081561090882777	0.0246324770717143	1.0	0.0850008911777496	0.0234766413812035	-0.0334418267952958	0.0850234017901974	0.047897759583028	0.0463685039698209	0.0271074691950865	0.3322376488776	0.0220472572043381	0.00710093218991589	-0.0907756318264573
"zmalocp"	-0.0935747342264917	0.250965886166486	0.351211428637203	0.197058944032952	0.284355725532703	0.741112179159034	0.0453405165629102	0.714623834663774	0.103697161163614	0.0375604147443511	-0.00394101139475663	0.0850008911777496	1.0	0.127113553573585	-0.136027821276442	0.968862263189562	0.164740161146402	0.103697286091709	0.226736866336244	0.0853630505881671	-0.161466648593968	0.092599301192262	-0.243846945133118
"XNUMYRS"	-0.0433124368850064	0.0051282003410214	0.209194134452711	-0.00113133485575159	0.110727716137827	0.100095387104534	0.11882299037684	0.0931213566146653	0.00759862277113247	-0.143043183221223	0.0227989678130104	0.0234766413812035	0.127113553573585	1.0	-0.105391280549597	0.126161051582714	0.102337613541426	0.0886507047080538	-0.00697880736209157	0.032739142015379	-0.144910901377402	0.894625228211102	-0.162120583336414
"zsdist"	0.0304561818550502	-0.0277078322096959	-0.252539248640695	-0.00300828808166533	-0.197056693384095	-0.155982477810229	-0.0531145356156115	-0.150986849920418	0.0147005522689167	-0.0421269210905451	-0.0547143513663696	-0.0334418267952958	-0.136027821276442	-0.105391280549597	1.0	-0.133569977870516	-0.109737331991694	-0.0954810223280262	-0.010377530561867	-0.0493510729840536	0.0961260580777503	-0.0735409943224634	0.144085823202949
"ZMALEVP"	-0.0905033898778264	0.250877326629872	0.349666367786342	0.199958806848278	0.282791561285406	0.733921345431609	0.0487202967761977	0.705562127393942	0.104273173708756	0.0384976843653409	-0.00537851598728793	0.0850234017901974	0.968862263189562	0.126161051582714	-0.133569977870516	1.0	0.163540746843369	0.102652511880384	0.225910294290296	0.0846944892406942	-0.164532282106996	0.0928069328873738	-0.242241792816222
"SINS2006"	0.0215932316350323	0.0155105256128017	0.106151036960665	-0.0175576715391245	0.356808990635777	0.0759885541863012	0.000193330440392355	0.0674431569272217	0.00612080736699575	0.0212825456712645	-0.00497845769255448	0.047897759583028	0.164740161146402	0.102337613541426	-0.109737331991694	0.163540746843369	1.0	-0.0254813821577379	-0.00259400871982444	0.0596906938383595	-0.0812639545909267	0.0841852235314292	-0.142858802157086
"numstu"	-0.0211938151563663	0.0720292202024169	0.238100393109102	0.17861964657897	0.292656468016612	0.127003228880236	-0.0272685551887227	0.117494370360593	0.0876821920885674	0.0796499445331421	0.557620436953908	0.0463685039698209	0.103697286091709	0.0886507047080538	-0.0954810223280262	0.102652511880384	-0.0254813821577379	1.0	0.0968886953692348	0.0569747698012059	-0.132976610500493	0.0415811443515997	-0.182156276725333
"ZMALEVT"	-0.00547253953239791	0.872384090645248	0.0541322474965005	0.330522422441687	0.0761703761894066	0.202551801551403	0.0696439050209671	0.195262694767212	0.265809385638639	0.1775653775201	0.0429320293177747	0.0271074691950865	0.226736866336244	-0.00697880736209157	-0.010377530561867	0.225910294290296	-0.00259400871982444	0.0968886953692348	1.0	0.0213705040171841	-0.00315762976158658	-0.0230672060150502	-0.0477584403702418
"PFALIVE"	-0.00110376944125852	0.0265895175967823	0.101990660668278	0.0118858580622151	0.121797767126875	0.0836016407442337	0.0021296498444582	0.0782027294108056	-0.00675589251744402	0.0862071416858673	0.0298955546988465	0.3322376488776	0.0853630505881671	0.032739142015379	-0.0493510729840536	0.0846944892406942	0.0596906938383595	0.0569747698012059	0.0213705040171841	1.0	0.01445715940387	0.013629794586023	-0.0964663634910348
"zpsibs"	0.0671436122410694	0.00367760827975287	-0.282273630374943	-0.0768685388397108	-0.0921437917560176	-0.168440177078353	-0.0013051773420848	-0.159438109675078	-0.0349990883065118	0.232349860416331	-0.0576098548154418	0.0220472572043381	-0.161466648593968	-0.144910901377402	0.0961260580777503	-0.164532282106996	-0.0812639545909267	-0.132976610500493	-0.00315762976158658	0.01445715940387	1.0	-0.146599284210159	0.237619631222025
"XAGE"	-0.0509819733546793	-0.00869879675197664	0.201449775767261	-0.0116822606232017	0.0229928660486551	0.0646324206317302	0.135485007065018	0.0576254598163014	0.00568762055729109	-0.217506310923711	-0.00701510089461803	0.00710093218991589	0.092599301192262	0.894625228211102	-0.0735409943224634	0.0928069328873738	0.0841852235314292	0.0415811443515997	-0.0230672060150502	0.013629794586023	-0.146599284210159	1.0	-0.150429790736099
"PAGE"	0.109461854921518	-0.0608468063017805	-0.45127610426051	-0.160649877538886	-0.18224819890896	-0.2564645128436	-0.042006278499272	-0.246419934792913	-0.0873264432910471	0.172200329614825	-0.0786883312963944	-0.0907756318264573	-0.243846945133118	-0.162120583336414	0.144085823202949	-0.242241792816222	-0.142858802157086	-0.182156276725333	-0.0477584403702418	-0.0964663634910348	0.237619631222025	-0.150429790736099	1.0

Rows: 1-23 | Columns: 24

Some variables are useless because they are categorizations of others. For example, most scores can go from 0 to 1000, and some variables are created by mapping these variables to a reduced interval (for example: 0 to 10), so we can drop them.

In [5]:

africa.drop(["ZMALEVT", 
             "ZRALEVT", 
             "ZRALEVP", 
             "ZMALEVP",
             "COUNTRY",
             "SCHOOL",
             "PUPIL"]).head(2)

Out[5]:

	123 PABSENT Int	Abc STCHPR05 Varchar(20)	Abc SPUPPR16 Varchar(20)	Abc zpmealsc Varchar(38)	Abc PREPEAT Varchar(20)	123 zmaloct Float	123 zpses Numeric(7,3)	Abc SPUPPR06 Varchar(20)	123 zraloct Float	Abc XSEX Varchar(20)	🌎 lon Numeric(11,7)	123 zralocp Float	Abc district Varchar(46)	Abc SPUPPR13 Varchar(20)	Abc SPUPPR09 Varchar(20)	Abc SPUPPR10 Varchar(20)	Abc zpsit Varchar(54)	Abc PNURSERY Varchar(38)	Abc STCHPR08 Varchar(20)	Abc country_long Varchar(24)	Abc XQPROFES Varchar(20)	Abc PTRAVEL2 Varchar(26)	Abc PTRAVEL Varchar(22)	🌎 lat Float	Abc PLIGHT Varchar(24)	...	123 XNUMYRS Numeric(7,3)	Abc PFATHER Varchar(68)	123 zsdist Numeric(7,2)	Abc PSEX Varchar(20)	Abc SLOCAT Varchar(20)	Abc province Varchar(44)	Abc zphmwkhl Varchar(56)	Abc XQPERMNT Varchar(36)	Abc SPUPPR04 Varchar(20)	Abc SPUPPR11 Varchar(20)	Abc STCHPR07 Varchar(20)	Abc SQACADEM Varchar(22)	Abc STCHPR04 Varchar(20)	123 SINS2006 Numeric(7,3)	123 numstu Int	010 PFALIVE Boolean	Abc STCHPR09 Varchar(20)	Abc SPUPPR15 Varchar(20)	Abc PENGLISH Varchar(32)	Abc SPUPPR12 Varchar(20)	123 zpsibs Int	123 XAGE Numeric(7,3)	Abc SPUPPR08 Varchar(20)	123 PAGE Int	Abc schoolname Varchar(116)
1	0	NEVER	NEVER	No	NEVER	469.293690770499	15.0	SOMETIMES	[null]	FEMALE	30.867464	726.682103722197	KZ	SOMETIMES	SOMETIMES	OFTEN	I have my own sitting place	THREE OR MORE YEARS	NEVER	South Africa	3 YRS TT	CAR	>0.5-1KM	-29.906887	ELECTRIC	...	26.0	Completed Some University	3.0	GIRL	LARGE CITY	UMLAZI	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	A-LEVEL	SOMETIMES	0.0	24	❌	NEVER	NEVER	ALL THE TIME	NEVER	1	48.0	SOMETIMES	12	MOORTON HEIGHTS PRIMARY SCHOOL
2	0	NEVER	NEVER	No	NEVER	492.584863319675	5.0	SOMETIMES	581.994282503848	FEMALE	16.252329	428.150211557773	Windhoek Rural	NEVER	SOMETIMES	SOMETIMES	I have my own sitting place	THREE OR MORE YEARS	NEVER	Namibia	>3 YRS TT	WALK	>4.5-5KM	-18.069998	PARAFFIN/OIL	...	10.0	I Do Not Know	1.6	BOY	LARGE CITY	Khomas	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	TERTIARY ED	SOMETIMES	2.0	23	✅	NEVER	NEVER	SOMETIMES	NEVER	8	34.0	SOMETIMES	14	Namibia Primary School

Rows: 1-2 | Columns: 59

Let's take a look at the missing values.

In [7]:

africa.count_percent()

Out[7]:

	count	percent
"PABSENT"	59909.0	100.0
"zpmealsc"	59909.0	100.0
"PREPEAT"	59909.0	100.0
"lon"	59909.0	100.0
"zralocp"	59909.0	100.0
"district"	59909.0	100.0
"zpsit"	59909.0	100.0
"PNURSERY"	59909.0	100.0
"country_long"	59909.0	100.0
"PTRAVEL2"	59909.0	100.0
"PTRAVEL"	59909.0	100.0
"lat"	59909.0	100.0
"PLIGHT"	59909.0	100.0
"REGION"	59909.0	100.0
"PMOTHER"	59909.0	100.0
"PMALIVE"	59909.0	100.0
"PSEX"	59909.0	100.0
"province"	59909.0	100.0
"zphmwkhl"	59909.0	100.0
"numstu"	59909.0	100.0
"PFALIVE"	59909.0	100.0
"PENGLISH"	59909.0	100.0
"zpsibs"	59909.0	100.0
"PAGE"	59909.0	100.0
"schoolname"	59909.0	100.0
"STYPE"	59882.0	99.955
"SLOCAT"	59882.0	99.955
"zpses"	59851.0	99.903
"zmalocp"	59829.0	99.866
"XQPROFES"	59728.0	99.698
"XNUMYRS"	59728.0	99.698
"XQPERMNT"	59728.0	99.698
"XAGE"	59728.0	99.698
"PFATHER"	59618.0	99.514
"STCHPR05"	59333.0	99.039
"SPUPPR16"	59333.0	99.039
"SPUPPR06"	59333.0	99.039
"SPUPPR13"	59333.0	99.039
"SPUPPR09"	59333.0	99.039
"SPUPPR10"	59333.0	99.039
"STCHPR08"	59333.0	99.039
"SPUPPR17"	59333.0	99.039
"SPUPPR07"	59333.0	99.039
"SPUPPR14"	59333.0	99.039
"STCHPR06"	59333.0	99.039
"SPUPPR04"	59333.0	99.039
"SPUPPR11"	59333.0	99.039
"STCHPR07"	59333.0	99.039
"SQACADEM"	59333.0	99.039
"STCHPR04"	59333.0	99.039
"STCHPR09"	59333.0	99.039
"SPUPPR15"	59333.0	99.039
"SPUPPR12"	59333.0	99.039
"SPUPPR08"	59333.0	99.039
"XSEX"	59222.0	98.853
"SINS2006"	58399.0	97.48
"zsdist"	57630.0	96.196
"zraloct"	53527.0	89.347
"zmaloct"	52912.0	88.321

Rows: 1-59 | Columns: 3

Many values are missing for 'zraloct' and 'zmaloct' which are the teachers' test scores. We need to find a way to impute them as they represent more than 10% of the dataset. For the others that represent less than 5% of the dataset, our goal is to identify what improves student performance, so we can filter them.

We'll use three variables to impute the teachers' scores: TEACHER'S SEX (XSEX), Teacher's Employment Status (XQPERMNT) and Teacher's Training (XQPROFES).

In [8]:

africa["zraloct"].fillna(method = "avg", 
                         by = ["XSEX", 
                               "XQPERMNT", 
                               "XQPROFES"])
africa["zmaloct"].fillna(method = "avg", 
                         by = ["XSEX", 
                               "XQPERMNT", 
                               "XQPROFES"])
africa.dropna()

6201 elements were filled.
6816 elements were filled.
3692 elements were filtered.

Out[8]:

	123 PABSENT Int	Abc STCHPR05 Varchar(20)	Abc SPUPPR16 Varchar(20)	Abc zpmealsc Varchar(38)	Abc PREPEAT Varchar(20)	123 zmaloct Float	123 zpses Numeric(7,3)	Abc SPUPPR06 Varchar(20)	123 zraloct Float	Abc XSEX Varchar(20)	🌎 lon Numeric(11,7)	123 zralocp Float	Abc district Varchar(46)	Abc SPUPPR13 Varchar(20)	Abc SPUPPR09 Varchar(20)	Abc SPUPPR10 Varchar(20)	Abc zpsit Varchar(54)	Abc PNURSERY Varchar(38)	Abc STCHPR08 Varchar(20)	Abc country_long Varchar(24)	Abc XQPROFES Varchar(20)	Abc PTRAVEL2 Varchar(26)	Abc PTRAVEL Varchar(22)	🌎 lat Float	Abc PLIGHT Varchar(24)	...	123 XNUMYRS Numeric(7,3)	Abc Varchar(68)	123 zsdist Numeric(7,2)	Abc PSEX Varchar(20)	Abc SLOCAT Varchar(20)	Abc province Varchar(44)	Abc zphmwkhl Varchar(56)	Abc XQPERMNT Varchar(36)	Abc SPUPPR04 Varchar(20)	Abc SPUPPR11 Varchar(20)	Abc STCHPR07 Varchar(20)	Abc SQACADEM Varchar(22)	Abc STCHPR04 Varchar(20)	123 SINS2006 Numeric(7,3)	123 numstu Int	010 PFALIVE Boolean	Abc STCHPR09 Varchar(20)	Abc SPUPPR15 Varchar(20)	Abc PENGLISH Varchar(32)	Abc SPUPPR12 Varchar(20)	123 zpsibs Int	123 XAGE Numeric(7,3)	Abc SPUPPR08 Varchar(20)	123 PAGE Int	Abc Varchar(116)
1	25	NEVER	NEVER	No	ONCE	803.02131290024	4.0	NEVER	777.327610028686	FEMALE	31.5686	626.726377527847	KAGERA	NEVER	SOMETIMES	SOMETIMES	I have my own sitting place	ONE YEAR	NEVER	Tanzania	1 YR TT	WALK	>2.5-3KM	-1.6762649	PARAFFIN/OIL	...	4.0		15.0	BOY	RURAL	KAGERA	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	JUNIOR SEC	NEVER	1.0	25	✅	NEVER	NEVER	MOST OF THE TIME	NEVER	4	26.0	SOMETIMES	16
2	24	NEVER	NEVER	No	NEVER	865.243624106494	3.0	SOMETIMES	777.327610028686	FEMALE	38.368149	443.792138175973	ARUSHA	NEVER	SOMETIMES	SOMETIMES	I have my own sitting place	ONE YEAR	NEVER	Tanzania	1 YR TT	WALK	>2.5-3KM	-5.0214324	FIRE	...	4.0		28.4	GIRL	RURAL	NORTHERN	No homework/Never/Sometimes	PERMANENT GOVT	OFTEN	NEVER	SOMETIMES	JUNIOR SEC	NEVER	0.0	24	✅	NEVER	NEVER	SOMETIMES	NEVER	5	23.0	NEVER	15
3	22	NEVER	NEVER	One per day	ONCE	803.746765127295	11.0	SOMETIMES	741.780846769329	FEMALE	57.493835	464.393700063358	Vacoas & West	NEVER	SOMETIMES	SOMETIMES	I have my own sitting place	THREE OR MORE YEARS	NEVER	Mauritius	1 YR TT	BUS/TRUCK/VAN	>1-1.5KM	-20.298403	ELECTRIC	...	32.0		1.0	BOY	LARGE CITY	4VA&W(G)	No homework/Never/Sometimes	PERMANENT GOVT	NEVER	SOMETIMES	NEVER	A-LEVEL	NEVER	0.0	23	✅	NEVER	NEVER	SOMETIMES	NEVER	2	58.0	SOMETIMES	12
4	18	NEVER	NEVER	No	NEVER	865.243624106494	4.0	SOMETIMES	777.327610028686	FEMALE	38.368149	535.35463545324	ARUSHA	NEVER	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Tanzania	1 YR TT	WALK	>0.5-1KM	-5.0214324	FIRE	...	4.0		28.4	BOY	RURAL	NORTHERN	No homework/Never/Sometimes	PERMANENT GOVT	OFTEN	NEVER	SOMETIMES	JUNIOR SEC	NEVER	0.0	24	✅	NEVER	NEVER	SOMETIMES	NEVER	7	23.0	NEVER	15
5	17	NEVER	NEVER	One per day	NEVER	803.746765127295	9.0	OFTEN	741.780846769329	FEMALE	57.503571	408.883936089015	Port Louis & North	NEVER	NEVER	SOMETIMES	I have my own sitting place	TWO YEARS	NEVER	Mauritius	1 YR TT	WALK	>1-1.5KM	-20.16304	ELECTRIC	...	28.0		1.0	BOY	LARGE CITY	1PL&N(G)	No homework/Never/Sometimes	PERMANENT GOVT	NEVER	SOMETIMES	SOMETIMES	A-LEVEL	NEVER	0.0	19	❌	NEVER	NEVER	NEVER	NEVER	1	49.0	NEVER	11
6	16	NEVER	NEVER	No	NEVER	865.243624106494	1.0	SOMETIMES	777.327610028686	FEMALE	38.368149	626.726377527847	ARUSHA	NEVER	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Tanzania	1 YR TT	WALK	>5KM	-5.0214324	FIRE	...	4.0		28.4	BOY	RURAL	NORTHERN	No homework/Never/Sometimes	PERMANENT GOVT	OFTEN	NEVER	SOMETIMES	JUNIOR SEC	NEVER	0.0	24	✅	NEVER	NEVER	NEVER	NEVER	16	23.0	NEVER	14
7	15	SOMETIMES	SOMETIMES	No	NEVER	761.727301665711	2.0	SOMETIMES	734.97995503795	FEMALE	29.661505	679.947079070258	TABORA	OFTEN	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	SOMETIMES	Tanzania	1 YR TT	WALK	>4.5-5KM	-4.8824091	FIRE	...	3.0		17.2	BOY	SMALLTOWN	WESTERN	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	OFTEN	OFTEN	SENIOR SEC	SOMETIMES	3.0	24	✅	OFTEN	SOMETIMES	ALL THE TIME	SOMETIMES	1	31.0	SOMETIMES	13
8	14	NEVER	NEVER	No	NEVER	923.752849833893	7.0	SOMETIMES	684.334448731461	FEMALE	38.764359	453.234520707691	ARUSHA	NEVER	SOMETIMES	SOMETIMES	I have my own sitting place	ONE YEAR	NEVER	Tanzania	1 YR TT	BICYCLE	>1-1.5KM	-5.192647	PARAFFIN/OIL	...	1.0		28.4	BOY	RURAL	NORTHERN	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	SENIOR SEC	NEVER	5.0	25	✅	NEVER	NEVER	ALL THE TIME	NEVER	12	22.0	SOMETIMES	15
9	14	NEVER	NEVER	No	NEVER	865.243624106494	1.0	SOMETIMES	777.327610028686	FEMALE	38.368149	517.042135997787	ARUSHA	NEVER	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Tanzania	1 YR TT	WALK	>0.5-1KM	-5.0214324	FIRE	...	4.0		28.4	BOY	RURAL	NORTHERN	Most of time/Always corrects	PERMANENT GOVT	OFTEN	NEVER	SOMETIMES	JUNIOR SEC	NEVER	0.0	24	❌	NEVER	NEVER	SOMETIMES	NEVER	8	23.0	NEVER	17
10	12	SOMETIMES	SOMETIMES	No	ONCE	761.727301665711	3.0	SOMETIMES	734.97995503795	FEMALE	29.661505	563.586405447064	TABORA	OFTEN	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	SOMETIMES	Tanzania	1 YR TT	WALK	>3-3.5KM	-4.8824091	PARAFFIN/OIL	...	3.0		17.2	GIRL	SMALLTOWN	WESTERN	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	OFTEN	OFTEN	SENIOR SEC	SOMETIMES	3.0	24	✅	OFTEN	SOMETIMES	ALL THE TIME	SOMETIMES	0	31.0	SOMETIMES	14
11	12	OFTEN	OFTEN	No	ONCE	629.181401844795	1.0	OFTEN	702.170060180262	FEMALE	39.624634	373.021957988751	MKOANI	OFTEN	OFTEN	OFTEN	I have my own sitting place	NEVER	OFTEN	Zanzibar	1 YR TT	WALK	>0.5-1KM	-5.3835955	PARAFFIN/OIL	...	32.0		4.2	BOY	RURAL	SOUTH PEMBA	No homework/Never/Sometimes	PERMANENT GOVT	OFTEN	OFTEN	OFTEN	SENIOR SEC	SOMETIMES	4.0	17	✅	OFTEN	OFTEN	ALL THE TIME	SOMETIMES	20	50.0	OFTEN	14
12	11	NEVER	SOMETIMES	One per day	THREE PLUS	817.536101590307	6.0	OFTEN	727.826634938163	FEMALE	27.554314	455.523583139623	QACHA'S NEK	SOMETIMES	OFTEN	OFTEN	I have my own sitting place	TWO YEARS	NEVER	Lesotho	1 YR TT	WALK	>4.5-5KM	-29.393061	CANDLE	...	4.0		40.8	GIRL	RURAL	QACHA'S NEK	No homework/Never/Sometimes	PERMANENT GOVT	OFTEN	OFTEN	SOMETIMES	PRIMARY	NEVER	3.0	25	✅	NEVER	OFTEN	ALL THE TIME	NEVER	3	25.0	NEVER	14
13	10	NEVER	SOMETIMES	One per day	ONCE	817.536101590307	3.0	OFTEN	727.826634938163	FEMALE	27.554314	473.168439385763	QACHA'S NEK	SOMETIMES	OFTEN	OFTEN	I have my own sitting place	NEVER	NEVER	Lesotho	1 YR TT	WALK	>4KM-4.5KM	-29.393061	CANDLE	...	4.0		40.8	BOY	RURAL	QACHA'S NEK	No homework/Never/Sometimes	PERMANENT GOVT	OFTEN	OFTEN	SOMETIMES	PRIMARY	NEVER	3.0	25	❌	NEVER	OFTEN	SOMETIMES	NEVER	4	25.0	NEVER	16
14	10	NEVER	NEVER	No	ONCE	865.243624106494	5.0	SOMETIMES	777.327610028686	FEMALE	38.368149	424.430485105884	ARUSHA	NEVER	SOMETIMES	SOMETIMES	I have my own sitting place	TWO YEARS	NEVER	Tanzania	1 YR TT	WALK	>2-2.5KM	-5.0214324	PARAFFIN/OIL	...	4.0		28.4	GIRL	RURAL	NORTHERN	No homework/Never/Sometimes	PERMANENT GOVT	OFTEN	NEVER	SOMETIMES	JUNIOR SEC	NEVER	0.0	24	✅	NEVER	NEVER	NEVER	NEVER	2	23.0	NEVER	18
15	10	NEVER	NEVER	No	ONCE	696.467011431304	4.0	SOMETIMES	672.41224856515	FEMALE	31.262636	573.314920782774	KAGERA	NEVER	SOMETIMES	SOMETIMES	I have my own sitting place	ONE YEAR	NEVER	Tanzania	1 YR TT	WALK	>2-2.5KM	-1.3001115	PARAFFIN/OIL	...	1.0		4.4	BOY	LARGE CITY	KAGERA	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	NEVER	SENIOR SEC	NEVER	3.0	23	❌	SOMETIMES	NEVER	SOMETIMES	SOMETIMES	0	22.0	SOMETIMES	17
16	10	NEVER	NEVER	No	ONCE	696.467011431304	3.0	SOMETIMES	672.41224856515	FEMALE	31.262636	517.042135997787	KAGERA	NEVER	SOMETIMES	SOMETIMES	I have my own sitting place	TWO YEARS	NEVER	Tanzania	1 YR TT	WALK	>2-2.5KM	-1.3001115	PARAFFIN/OIL	...	1.0		4.4	BOY	LARGE CITY	KAGERA	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	NEVER	SENIOR SEC	NEVER	3.0	23	✅	SOMETIMES	NEVER	SOMETIMES	SOMETIMES	2	22.0	SOMETIMES	15
17	10	NEVER	NEVER	No	NEVER	865.243624106494	1.0	SOMETIMES	777.327610028686	FEMALE	38.368149	626.726377527847	ARUSHA	NEVER	SOMETIMES	SOMETIMES	I have my own sitting place	ONE YEAR	NEVER	Tanzania	1 YR TT	WALK	UP TO 0.5KM	-5.0214324	FIRE	...	4.0		28.4	BOY	RURAL	NORTHERN	No homework/Never/Sometimes	PERMANENT GOVT	OFTEN	NEVER	SOMETIMES	JUNIOR SEC	NEVER	0.0	24	❌	NEVER	NEVER	NEVER	NEVER	6	23.0	NEVER	16
18	10	NEVER	NEVER	No	NEVER	846.115608003305	6.0	NEVER	882.719859498874	FEMALE	32.546715	577.225402437324	Matutuine	SOMETIMES	SOMETIMES	OFTEN	I have my own sitting place	NEVER	NEVER	Mozambique	1 YR TT	WALK	UP TO 0.5KM	-25.850182	PARAFFIN/OIL	...	27.0		3.6	BOY	LARGE CITY	Maputo	Most of time/Always corrects	PERMANENT GOVT	OFTEN	NEVER	NEVER	JUNIOR SEC	NEVER	0.0	21	❌	NEVER	NEVER	SOMETIMES	NEVER	6	46.0	OFTEN	13
19	9	OFTEN	OFTEN	No	TWICE	848.478480580758	5.0	OFTEN	679.756323867598	FEMALE	35.253304	490.431785226581	Salima	OFTEN	OFTEN	OFTEN	No place/share	THREE OR MORE YEARS	SOMETIMES	Malawi	1 YR TT	WALK	>2.5-3KM	-14.486174	CANDLE	...	12.0		4.8	BOY	LARGE CITY	Central eastern	No homework/Never/Sometimes	PERMANENT GOVT	OFTEN	OFTEN	OFTEN	SENIOR SEC	OFTEN	10.0	19	✅	SOMETIMES	OFTEN	NEVER	SOMETIMES	3	40.0	SOMETIMES	13
20	9	NEVER	NEVER	No	TWICE	817.536101590307	5.0	SOMETIMES	734.97995503795	FEMALE	38.820545	615.185687766858	KAGERA	NEVER	NEVER	NEVER	I have my own sitting place	ONE YEAR	NEVER	Tanzania	1 YR TT	WALK	UP TO 0.5KM	-7.3237715	PARAFFIN/OIL	...	3.0		2.0	GIRL	SMALLTOWN	KAGERA	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	JUNIOR SEC	NEVER	15.0	22	✅	NEVER	NEVER	MOST OF THE TIME	NEVER	4	26.0	SOMETIMES	16
21	9	NEVER	NEVER	No	ONCE	817.536101590307	3.0	SOMETIMES	734.97995503795	FEMALE	38.820545	665.258928465364	KAGERA	NEVER	NEVER	NEVER	I have my own sitting place	ONE YEAR	NEVER	Tanzania	1 YR TT	WALK	>1.5-2KM	-7.3237715	PARAFFIN/OIL	...	3.0		2.0	BOY	SMALLTOWN	KAGERA	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	JUNIOR SEC	NEVER	15.0	22	❌	NEVER	NEVER	SOMETIMES	NEVER	0	26.0	SOMETIMES	16
22	9	NEVER	NEVER	No	ONCE	775.229430679726	4.0	OFTEN	649.235491441842	FEMALE	36.865391	517.042135997787	TANGA	NEVER	OFTEN	OFTEN	I have my own sitting place	ONE YEAR	NEVER	Tanzania	1 YR TT	WALK	>4KM-4.5KM	-7.9390264	PARAFFIN/OIL	...	3.0		5.2	BOY	RURAL	NORTHEAST	No homework/Never/Sometimes	PERMANENT GOVT	OFTEN	OFTEN	NEVER	JUNIOR SEC	SOMETIMES	1.0	25	✅	NEVER	NEVER	MOST OF THE TIME	NEVER	4	34.0	OFTEN	13
23	9	NEVER	NEVER	No	NEVER	775.229430679726	4.0	SOMETIMES	709.037247476057	FEMALE	37.355629	573.314920782774	MWANZA	NEVER	OFTEN	SOMETIMES	I have my own sitting place	NEVER	NEVER	Tanzania	1 YR TT	WALK	UP TO 0.5KM	-3.0674248	FIRE	...	3.0		13.8	BOY	RURAL	MWANZA	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	SENIOR SEC	NEVER	2.0	17	✅	NEVER	NEVER	SOMETIMES	NEVER	3	24.0	SOMETIMES	16
24	8	SOMETIMES	NEVER	No	NEVER	761.727301665711	5.0	SOMETIMES	684.334448731461	FEMALE	38.352764	626.726377527847	ARUSHA	SOMETIMES	NEVER	SOMETIMES	I have my own sitting place	ONE YEAR	NEVER	Tanzania	1 YR TT	WALK	UP TO 0.5KM	-4.8925924	PARAFFIN/OIL	...	1.0		6.6	BOY	RURAL	NORTHERN	No homework/Never/Sometimes	PERMANENT GOVT	NEVER	NEVER	SOMETIMES	JUNIOR SEC	NEVER	1.0	18	✅	NEVER	NEVER	SOMETIMES	SOMETIMES	4	23.0	SOMETIMES	14
25	8	NEVER	NEVER	No	ONCE	696.467011431304	5.0	SOMETIMES	672.41224856515	FEMALE	31.262636	526.103008124183	KAGERA	NEVER	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Tanzania	1 YR TT	WALK	>3-3.5KM	-1.3001115	PARAFFIN/OIL	...	1.0		4.4	BOY	LARGE CITY	KAGERA	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	SOMETIMES	NEVER	SENIOR SEC	NEVER	3.0	23	✅	SOMETIMES	NEVER	SOMETIMES	SOMETIMES	2	22.0	SOMETIMES	15
26	8	NEVER	NEVER	No	NEVER	848.478480580758	13.0	SOMETIMES	884.627411525484	FEMALE	31.415178	640.365374518107	KZ	SOMETIMES	SOMETIMES	SOMETIMES	I have my own sitting place	ONE YEAR	NEVER	South Africa	1 YR TT	WALK	>0.5-1KM	-29.177347	ELECTRIC	...	12.0		8.8	BOY	RURAL	ILEMBE	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	SOMETIMES	NEVER	TERTIARY ED	NEVER	4.0	24	❌	NEVER	NEVER	ALL THE TIME	NEVER	1	47.0	SOMETIMES	12
27	8	NEVER	NEVER	No	NEVER	803.02131290024	4.0	NEVER	615.471820570849	FEMALE	31.707684	638.743955295488	KILIMANJARO	NEVER	NEVER	NEVER	I have my own sitting place	TWO YEARS	NEVER	Tanzania	1 YR TT	WALK	UP TO 0.5KM	-1.5407997	PARAFFIN/OIL	...	3.0		6.4	GIRL	RURAL	KILIMANJARO	Most of time/Always corrects	PERMANENT GOVT	NEVER	NEVER	NEVER	SENIOR SEC	SOMETIMES	1.0	25	✅	NEVER	NEVER	SOMETIMES	NEVER	3	30.0	NEVER	14
28	8	NEVER	NEVER	No	NEVER	803.02131290024	4.0	NEVER	777.327610028686	FEMALE	31.5686	695.97051609378	KAGERA	NEVER	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Tanzania	1 YR TT	WALK	>1-1.5KM	-1.6762649	PARAFFIN/OIL	...	4.0		15.0	GIRL	RURAL	KAGERA	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	JUNIOR SEC	NEVER	1.0	25	❌	NEVER	NEVER	SOMETIMES	NEVER	1	26.0	SOMETIMES	15
29	8	NEVER	NEVER	No	NEVER	696.467011431304	5.0	SOMETIMES	672.41224856515	FEMALE	31.262636	638.743955295488	KAGERA	NEVER	SOMETIMES	SOMETIMES	I have my own sitting place	ONE YEAR	NEVER	Tanzania	1 YR TT	WALK	UP TO 0.5KM	-1.3001115	PARAFFIN/OIL	...	1.0		4.4	BOY	LARGE CITY	KAGERA	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	NEVER	SENIOR SEC	NEVER	3.0	23	✅	SOMETIMES	NEVER	SOMETIMES	SOMETIMES	3	22.0	SOMETIMES	14
30	8	NEVER	NEVER	No	NEVER	696.467011431304	4.0	SOMETIMES	672.41224856515	FEMALE	31.262636	638.743955295488	KAGERA	NEVER	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Tanzania	1 YR TT	WALK	>2-2.5KM	-1.3001115	PARAFFIN/OIL	...	1.0		4.4	BOY	LARGE CITY	KAGERA	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	SOMETIMES	NEVER	SENIOR SEC	NEVER	3.0	23	❌	SOMETIMES	NEVER	SOMETIMES	SOMETIMES	1	22.0	SOMETIMES	14
31	8	NEVER	NEVER	No	NEVER	656.860766323526	4.0	SOMETIMES	624.628070298576	FEMALE	33.855083	388.47312940429	Kasungu	NEVER	NEVER	NEVER	No place/share	NEVER	NEVER	Malawi	1 YR TT	WALK	>1-1.5KM	-11.017195	PARAFFIN/OIL	...	14.0		17.8	GIRL	RURAL	Northern	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	A-LEVEL	NEVER	4.0	23	✅	NEVER	NEVER	SOMETIMES	NEVER	2	37.0	NEVER	13
32	7	SOMETIMES	SOMETIMES	No	NEVER	761.727301665711	4.0	SOMETIMES	734.97995503795	FEMALE	29.661505	526.103008124183	TABORA	OFTEN	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	SOMETIMES	Tanzania	1 YR TT	WALK	>1-1.5KM	-4.8824091	PARAFFIN/OIL	...	3.0		17.2	BOY	SMALLTOWN	WESTERN	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	OFTEN	OFTEN	SENIOR SEC	SOMETIMES	3.0	24	✅	OFTEN	SOMETIMES	ALL THE TIME	SOMETIMES	4	31.0	SOMETIMES	14
33	7	OFTEN	SOMETIMES	No	NEVER	670.250377595758	13.0	OFTEN	741.780846769329	FEMALE	39.222092	514.276185559203	URBAN	OFTEN	OFTEN	OFTEN	I have my own sitting place	THREE OR MORE YEARS	OFTEN	Zanzibar	1 YR TT	WALK	UP TO 0.5KM	-6.1664729	ELECTRIC	...	25.0		1.0	GIRL	LARGE CITY	URBAN WEST	No homework/Never/Sometimes	PERMANENT GOVT	OFTEN	OFTEN	OFTEN	A-LEVEL	OFTEN	0.0	21	✅	OFTEN	SOMETIMES	MOST OF THE TIME	OFTEN	3	45.0	OFTEN	13
34	7	OFTEN	OFTEN	No	NEVER	848.478480580758	8.0	OFTEN	642.082171342055	FEMALE	39.754951	584.760232942433	WETE	OFTEN	SOMETIMES	OFTEN	I have my own sitting place	NEVER	OFTEN	Zanzibar	1 YR TT	WALK	>1-1.5KM	-4.9839821	PARAFFIN/OIL	...	7.0		6.6	GIRL	RURAL	NORTH PEMBA	No homework/Never/Sometimes	PERMANENT GOVT	OFTEN	OFTEN	OFTEN	A-LEVEL	OFTEN	1.0	16	✅	OFTEN	OFTEN	ALL THE TIME	OFTEN	14	26.0	OFTEN	15
35	7	NEVER	SOMETIMES	No	NEVER	735.398150088381	12.0	SOMETIMES	740.607233516448	FEMALE	55.485935	455.523583139623	West	SOMETIMES	SOMETIMES	SOMETIMES	I have my own sitting place	TWO YEARS	NEVER	Seychelles	1 YR TT	BUS/TRUCK/VAN	>3.5-4KM	-4.7047267	ELECTRIC	...	32.0		7.6	GIRL	RURAL	West	Most of time/Always corrects	PERMANENT GOVT	NEVER	NEVER	SOMETIMES	A-LEVEL	SOMETIMES	0.0	98	✅	NEVER	NEVER	MOST OF THE TIME	NEVER	2	53.0	SOMETIMES	11
36	7	NEVER	NEVER	One per day	NEVER	696.467011431304	8.0	SOMETIMES	668.40638930927	FEMALE	31.203329	408.883936089015	MP	NEVER	NEVER	SOMETIMES	I have my own sitting place	TWO YEARS	NEVER	South Africa	1 YR TT	WALK	>5KM	-24.958431	ELECTRIC	...	16.0		25.0	BOY	RURAL	NOT APPLICABLE	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	TERTIARY ED	NEVER	18.0	24	✅	NEVER	NEVER	NEVER	NEVER	9	48.0	NEVER	12
37	7	NEVER	NEVER	No	TWICE	775.229430679726	4.0	OFTEN	649.235491441842	FEMALE	36.865391	498.920391744994	TANGA	NEVER	OFTEN	OFTEN	I have my own sitting place	ONE YEAR	NEVER	Tanzania	1 YR TT	WALK	>0.5-1KM	-7.9390264	PARAFFIN/OIL	...	3.0		5.2	BOY	RURAL	NORTHEAST	No homework/Never/Sometimes	PERMANENT GOVT	OFTEN	OFTEN	NEVER	JUNIOR SEC	SOMETIMES	1.0	25	❌	NEVER	NEVER	NEVER	NEVER	1	34.0	OFTEN	13
38	7	NEVER	NEVER	No	ONCE	817.536101590307	3.0	SOMETIMES	734.97995503795	FEMALE	38.820545	615.185687766858	KAGERA	NEVER	NEVER	NEVER	I have my own sitting place	ONE YEAR	NEVER	Tanzania	1 YR TT	WALK	UP TO 0.5KM	-7.3237715	PARAFFIN/OIL	...	3.0		2.0	GIRL	SMALLTOWN	KAGERA	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	JUNIOR SEC	NEVER	15.0	22	❌	NEVER	NEVER	SOMETIMES	NEVER	2	26.0	SOMETIMES	16
39	7	NEVER	NEVER	No	ONCE	761.727301665711	5.0	SOMETIMES	672.41224856515	FEMALE	37.659115	626.726377527847	TANGA	SOMETIMES	SOMETIMES	OFTEN	I have my own sitting place	ONE YEAR	NEVER	Tanzania	1 YR TT	WALK	UP TO 0.5KM	-6.8277555	PARAFFIN/OIL	...	4.0		20.6	BOY	SMALLTOWN	NORTHEAST	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	JUNIOR SEC	NEVER	2.0	25	✅	NEVER	NEVER	ALL THE TIME	NEVER	5	25.0	SOMETIMES	14
40	7	NEVER	NEVER	No	ONCE	722.458609783283	5.0	SOMETIMES	753.864720101386	FEMALE	55.693951	398.773910347983	Island	SOMETIMES	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Seychelles	1 YR TT	WALK	>1-1.5KM	-4.3190727	ELECTRIC	...	38.0		2.0	BOY	SMALLTOWN	Island	Most of time/Always corrects	PERMANENT GOVT	NEVER	SOMETIMES	SOMETIMES	A-LEVEL	SOMETIMES	1.0	71	✅	NEVER	NEVER	NEVER	NEVER	6	58.0	SOMETIMES	12
41	7	NEVER	NEVER	No	NEVER	902.486996636819	3.0	SOMETIMES	762.639459423791	FEMALE	32.91745	507.981263871391	MWANZA	NEVER	SOMETIMES	SOMETIMES	I have my own sitting place	ONE YEAR	NEVER	Tanzania	1 YR TT	WALK	UP TO 0.5KM	-2.5164306	PARAFFIN/OIL	...	4.0		15.8	GIRL	RURAL	MWANZA	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	SENIOR SEC	SOMETIMES	0.0	25	✅	SOMETIMES	NEVER	NEVER	NEVER	11	27.0	SOMETIMES	15
42	7	NEVER	NEVER	No	NEVER	817.536101590307	4.0	SOMETIMES	734.97995503795	FEMALE	38.820545	695.97051609378	KAGERA	NEVER	NEVER	NEVER	I have my own sitting place	ONE YEAR	NEVER	Tanzania	1 YR TT	WALK	>1-1.5KM	-7.3237715	PARAFFIN/OIL	...	3.0		2.0	BOY	SMALLTOWN	KAGERA	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	JUNIOR SEC	NEVER	15.0	22	✅	NEVER	NEVER	SOMETIMES	NEVER	5	26.0	SOMETIMES	17
43	6	SOMETIMES	SOMETIMES	No	NEVER	832.61347898929	4.0	SOMETIMES	684.334448731461	FEMALE	29.661505	583.329568922475	TABORA	SOMETIMES	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	OFTEN	Tanzania	1 YR TT	WALK	>1.5-2KM	-4.8824091	PARAFFIN/OIL	...	5.0		9.4	BOY	SMALLTOWN	WESTERN	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	OFTEN	SENIOR SEC	SOMETIMES	0.0	25	✅	OFTEN	SOMETIMES	MOST OF THE TIME	SOMETIMES	3	26.0	SOMETIMES	15
44	6	SOMETIMES	SOMETIMES	No	NEVER	832.61347898929	3.0	SOMETIMES	684.334448731461	FEMALE	29.661505	573.314920782774	TABORA	SOMETIMES	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	OFTEN	Tanzania	1 YR TT	WALK	>1.5-2KM	-4.8824091	PARAFFIN/OIL	...	5.0		9.4	GIRL	SMALLTOWN	WESTERN	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	SOMETIMES	OFTEN	SENIOR SEC	SOMETIMES	0.0	25	✅	OFTEN	SOMETIMES	ALL THE TIME	SOMETIMES	4	26.0	SOMETIMES	13
45	6	OFTEN	SOMETIMES	No	NEVER	670.250377595758	7.0	OFTEN	741.780846769329	FEMALE	39.222092	514.276185559203	URBAN	OFTEN	OFTEN	OFTEN	I have my own sitting place	THREE OR MORE YEARS	OFTEN	Zanzibar	1 YR TT	WALK	>0.5-1KM	-6.1664729	ELECTRIC	...	25.0		1.0	BOY	LARGE CITY	URBAN WEST	No homework/Never/Sometimes	PERMANENT GOVT	OFTEN	OFTEN	OFTEN	A-LEVEL	OFTEN	0.0	21	✅	OFTEN	SOMETIMES	ALL THE TIME	OFTEN	4	45.0	OFTEN	16
46	6	NEVER	SOMETIMES	One per day	NEVER	817.536101590307	3.0	OFTEN	727.826634938163	FEMALE	27.554314	455.523583139623	QACHA'S NEK	SOMETIMES	OFTEN	OFTEN	I have my own sitting place	TWO YEARS	NEVER	Lesotho	1 YR TT	WALK	UP TO 0.5KM	-29.393061	CANDLE	...	4.0		40.8	GIRL	RURAL	QACHA'S NEK	No homework/Never/Sometimes	PERMANENT GOVT	OFTEN	OFTEN	SOMETIMES	PRIMARY	NEVER	3.0	25	✅	NEVER	OFTEN	SOMETIMES	NEVER	2	25.0	NEVER	14
47	6	NEVER	SOMETIMES	One per day	NEVER	683.414953384423	4.0	SOMETIMES	657.247209953603	FEMALE	35.25	418.612451424724	Thyolo	SOMETIMES	SOMETIMES	SOMETIMES	No place/share	NEVER	NEVER	Malawi	1 YR TT	WALK	>2-2.5KM	-15.5	PARAFFIN/OIL	...	9.0		2.8	GIRL	LARGE CITY	Southern western	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	SENIOR SEC	SOMETIMES	6.0	23	❌	NEVER	SOMETIMES	SOMETIMES	NEVER	5	30.0	SOMETIMES	14
48	6	NEVER	SOMETIMES	No	NEVER	735.398150088381	11.0	SOMETIMES	740.607233516448	FEMALE	55.485935	428.150211557773	West	SOMETIMES	SOMETIMES	SOMETIMES	I have my own sitting place	TWO YEARS	NEVER	Seychelles	1 YR TT	BUS/TRUCK/VAN	>3-3.5KM	-4.7047267	ELECTRIC	...	32.0		7.6	BOY	RURAL	West	Most of time/Always corrects	PERMANENT GOVT	NEVER	NEVER	SOMETIMES	A-LEVEL	SOMETIMES	0.0	98	✅	NEVER	NEVER	SOMETIMES	NEVER	0	53.0	SOMETIMES	11
49	6	NEVER	SOMETIMES	No	NEVER	735.398150088381	11.0	SOMETIMES	740.607233516448	FEMALE	55.485935	418.612451424724	West	SOMETIMES	SOMETIMES	SOMETIMES	I have my own sitting place	TWO YEARS	NEVER	Seychelles	1 YR TT	BUS/TRUCK/VAN	>2.5-3KM	-4.7047267	ELECTRIC	...	32.0		7.6	GIRL	RURAL	West	Most of time/Always corrects	PERMANENT GOVT	NEVER	NEVER	SOMETIMES	A-LEVEL	SOMETIMES	0.0	98	✅	NEVER	NEVER	MOST OF THE TIME	NEVER	1	53.0	SOMETIMES	11
50	6	NEVER	SOMETIMES	No	NEVER	735.398150088381	9.0	SOMETIMES	740.607233516448	FEMALE	55.485935	329.243638978058	West	SOMETIMES	SOMETIMES	SOMETIMES	I have my own sitting place	THREE OR MORE YEARS	NEVER	Seychelles	1 YR TT	BUS/TRUCK/VAN	>3.5-4KM	-4.7047267	ELECTRIC	...	32.0		7.6	GIRL	RURAL	West	No homework/Never/Sometimes	PERMANENT GOVT	NEVER	NEVER	SOMETIMES	A-LEVEL	SOMETIMES	0.0	98	✅	NEVER	NEVER	NEVER	NEVER	8	53.0	SOMETIMES	12
51	6	NEVER	NEVER	One per day	ONCE	748.562725877046	10.0	SOMETIMES	864.598115246081	FEMALE	15.327754	746.711400001599	Oranjemund	SOMETIMES	SOMETIMES	OFTEN	I have my own sitting place	A FEW MONTHS	NEVER	Namibia	1 YR TT	WALK	UP TO 0.5KM	-17.442753	ELECTRIC	...	13.0		2.4	BOY	LARGE CITY	Karas	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	SENIOR SEC	NEVER	0.0	23	✅	NEVER	NEVER	SOMETIMES	NEVER	4	36.0	SOMETIMES	13
52	6	NEVER	NEVER	One per day	NEVER	803.746765127295	12.0	NEVER	741.780846769329	FEMALE	57.501221	398.773910347983	Port Louis & North	NEVER	SOMETIMES	NEVER	I have my own sitting place	TWO YEARS	NEVER	Mauritius	1 YR TT	CAR	>5KM	-20.160891	ELECTRIC	...	28.0		1.2	BOY	SMALLTOWN	1PL&N(G)	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	SOMETIMES	SENIOR SEC	NEVER	25.0	21	✅	NEVER	NEVER	SOMETIMES	NEVER	1	53.0	SOMETIMES	11
53	6	NEVER	NEVER	No	ONCE	761.727301665711	3.0	NEVER	696.542781701763	FEMALE	36.02354	498.920391744994	DODOMA	NEVER	NEVER	NEVER	I have my own sitting place	NEVER	NEVER	Tanzania	1 YR TT	WALK	UP TO 0.5KM	-5.634428	PARAFFIN/OIL	...	3.0		43.8	BOY	RURAL	CENTRAL	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	PRIMARY	NEVER	2.0	19	✅	NEVER	NEVER	NEVER	NEVER	1	25.0	NEVER	14
54	6	NEVER	NEVER	No	ONCE	696.467011431304	10.0	SOMETIMES	672.41224856515	FEMALE	31.262636	553.953267712685	KAGERA	NEVER	SOMETIMES	SOMETIMES	I have my own sitting place	TWO YEARS	NEVER	Tanzania	1 YR TT	WALK	UP TO 0.5KM	-1.3001115	ELECTRIC	...	1.0		4.4	GIRL	LARGE CITY	KAGERA	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	SOMETIMES	NEVER	SENIOR SEC	NEVER	3.0	23	✅	SOMETIMES	NEVER	SOMETIMES	SOMETIMES	8	22.0	SOMETIMES	14
55	6	NEVER	NEVER	No	ONCE	696.467011431304	4.0	SOMETIMES	672.41224856515	FEMALE	31.262636	507.981263871391	KAGERA	NEVER	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Tanzania	1 YR TT	WALK	>3-3.5KM	-1.3001115	PARAFFIN/OIL	...	1.0		4.4	BOY	LARGE CITY	KAGERA	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	NEVER	SENIOR SEC	NEVER	3.0	23	✅	SOMETIMES	NEVER	SOMETIMES	SOMETIMES	3	22.0	SOMETIMES	15
56	6	NEVER	NEVER	No	ONCE	635.707430868236	1.0	NEVER	709.132625077388	FEMALE	38.689674	433.300602029619	Muembe	SOMETIMES	SOMETIMES	NEVER	I have my own sitting place	NEVER	NEVER	Mozambique	1 YR TT	WALK	>3.5-4KM	-15.453712	FIRE	...	20.0		4.2	BOY	LARGE CITY	Niassa	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	PRIMARY	NEVER	2.0	16	❌	NEVER	NEVER	SOMETIMES	NEVER	5	38.0	NEVER	14
57	6	NEVER	NEVER	No	NEVER	902.486996636819	6.0	SOMETIMES	777.327610028686	FEMALE	37.359749	544.606262782297	MWANZA	NEVER	NEVER	NEVER	I have my own sitting place	NEVER	NEVER	Tanzania	1 YR TT	WALK	>2-2.5KM	-3.0499003	GAS	...	1.0		7.8	BOY	RURAL	MWANZA	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	SENIOR SEC	NEVER	0.0	23	✅	NEVER	NEVER	ALL THE TIME	NEVER	5	30.0	NEVER	16
58	6	NEVER	NEVER	No	NEVER	902.486996636819	4.0	SOMETIMES	777.327610028686	FEMALE	37.359749	544.606262782297	MWANZA	NEVER	NEVER	NEVER	I have my own sitting place	NEVER	NEVER	Tanzania	1 YR TT	WALK	>4.5-5KM	-3.0499003	PARAFFIN/OIL	...	1.0		7.8	BOY	RURAL	MWANZA	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	SENIOR SEC	NEVER	0.0	23	❌	NEVER	NEVER	MOST OF THE TIME	NEVER	0	30.0	NEVER	15
59	6	NEVER	NEVER	No	NEVER	865.243624106494	3.0	SOMETIMES	777.327610028686	FEMALE	38.368149	563.586405447064	ARUSHA	NEVER	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Tanzania	1 YR TT	WALK	>2-2.5KM	-5.0214324	PARAFFIN/OIL	...	4.0		28.4	BOY	RURAL	NORTHERN	No homework/Never/Sometimes	PERMANENT GOVT	OFTEN	NEVER	SOMETIMES	JUNIOR SEC	NEVER	0.0	24	✅	NEVER	NEVER	ALL THE TIME	NEVER	3	23.0	NEVER	18
60	6	NEVER	NEVER	No	NEVER	865.243624106494	3.0	SOMETIMES	777.327610028686	FEMALE	38.368149	593.534972264837	ARUSHA	NEVER	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Tanzania	1 YR TT	WALK	>3-3.5KM	-5.0214324	FIRE	...	4.0		28.4	BOY	RURAL	NORTHERN	Most of time/Always corrects	PERMANENT GOVT	OFTEN	NEVER	SOMETIMES	JUNIOR SEC	NEVER	0.0	24	✅	NEVER	NEVER	SOMETIMES	NEVER	11	23.0	NEVER	13
61	6	NEVER	NEVER	No	NEVER	817.536101590307	2.0	SOMETIMES	734.97995503795	FEMALE	38.820545	615.185687766858	KAGERA	NEVER	NEVER	NEVER	I have my own sitting place	NEVER	NEVER	Tanzania	1 YR TT	WALK	>3.5-4KM	-7.3237715	PARAFFIN/OIL	...	3.0		2.0	BOY	SMALLTOWN	KAGERA	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	JUNIOR SEC	NEVER	15.0	22	✅	NEVER	NEVER	ALL THE TIME	NEVER	5	26.0	SOMETIMES	16
62	6	NEVER	NEVER	No	NEVER	817.536101590307	1.0	SOMETIMES	734.97995503795	FEMALE	38.820545	651.619931475104	KAGERA	NEVER	NEVER	NEVER	I have my own sitting place	NEVER	NEVER	Tanzania	1 YR TT	WALK	>3-3.5KM	-7.3237715	PARAFFIN/OIL	...	3.0		2.0	BOY	SMALLTOWN	KAGERA	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	JUNIOR SEC	NEVER	15.0	22	❌	NEVER	NEVER	ALL THE TIME	NEVER	1	26.0	SOMETIMES	15
63	6	NEVER	NEVER	No	NEVER	788.956595177308	11.0	SOMETIMES	846.094860587967	FEMALE	55.463776	418.612451424724	West	SOMETIMES	SOMETIMES	OFTEN	I have my own sitting place	TWO YEARS	NEVER	Seychelles	1 YR TT	BUS/TRUCK/VAN	>0.5-1KM	-4.677392	ELECTRIC	...	2.0		3.8	BOY	ISOLATED	West	No homework/Never/Sometimes	PERMANENT GOVT	NEVER	NEVER	NEVER	TERTIARY ED	SOMETIMES	0.0	41	✅	NEVER	NEVER	NEVER	NEVER	3	32.0	SOMETIMES	12
64	6	NEVER	NEVER	No	NEVER	722.458609783283	9.0	SOMETIMES	753.864720101386	FEMALE	55.693951	342.405747961665	Island	SOMETIMES	SOMETIMES	SOMETIMES	I have my own sitting place	TWO YEARS	NEVER	Seychelles	1 YR TT	BUS/TRUCK/VAN	>3-3.5KM	-4.3190727	ELECTRIC	...	38.0		2.0	BOY	SMALLTOWN	Island	Most of time/Always corrects	PERMANENT GOVT	NEVER	SOMETIMES	SOMETIMES	A-LEVEL	SOMETIMES	1.0	71	✅	NEVER	NEVER	NEVER	NEVER	3	58.0	SOMETIMES	12
65	5	SOMETIMES	SOMETIMES	No	NEVER	832.61347898929	3.0	SOMETIMES	684.334448731461	FEMALE	29.661505	573.314920782774	TABORA	SOMETIMES	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	OFTEN	Tanzania	1 YR TT	WALK	>2-2.5KM	-4.8824091	PARAFFIN/OIL	...	5.0		9.4	GIRL	SMALLTOWN	WESTERN	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	SOMETIMES	OFTEN	SENIOR SEC	SOMETIMES	0.0	25	❌	OFTEN	SOMETIMES	ALL THE TIME	SOMETIMES	13	26.0	SOMETIMES	14
66	5	OFTEN	SOMETIMES	No	NEVER	923.752849833893	6.0	SOMETIMES	777.327610028686	FEMALE	36.026806	638.743955295488	DODOMA	SOMETIMES	SOMETIMES	SOMETIMES	I have my own sitting place	ONE YEAR	SOMETIMES	Tanzania	1 YR TT	WALK	UP TO 0.5KM	-6.1395359	NO LIGHTING	...	2.0		7.6	GIRL	RURAL	CENTRAL	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	A-LEVEL	OFTEN	0.0	24	✅	SOMETIMES	SOMETIMES	ALL THE TIME	OFTEN	1	25.0	SOMETIMES	12
67	5	OFTEN	SOMETIMES	No	NEVER	923.752849833893	4.0	SOMETIMES	777.327610028686	FEMALE	36.026806	638.743955295488	DODOMA	SOMETIMES	SOMETIMES	SOMETIMES	I have my own sitting place	ONE YEAR	SOMETIMES	Tanzania	1 YR TT	WALK	>5KM	-6.1395359	PARAFFIN/OIL	...	2.0		7.6	BOY	RURAL	CENTRAL	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	A-LEVEL	OFTEN	0.0	24	✅	SOMETIMES	SOMETIMES	ALL THE TIME	OFTEN	4	25.0	SOMETIMES	15
68	5	OFTEN	OFTEN	No	THREE PLUS	848.478480580758	6.0	OFTEN	679.756323867598	FEMALE	35.253304	418.612451424724	Salima	OFTEN	OFTEN	OFTEN	No place/share	NEVER	SOMETIMES	Malawi	1 YR TT	WALK	>0.5-1KM	-14.486174	CANDLE	...	12.0		4.8	BOY	LARGE CITY	Central eastern	No homework/Never/Sometimes	PERMANENT GOVT	OFTEN	OFTEN	OFTEN	SENIOR SEC	OFTEN	10.0	19	✅	SOMETIMES	OFTEN	NEVER	SOMETIMES	7	40.0	SOMETIMES	17
69	5	OFTEN	OFTEN	No	ONCE	848.478480580758	3.0	OFTEN	642.082171342055	FEMALE	39.754951	563.491027845734	WETE	OFTEN	SOMETIMES	OFTEN	I have my own sitting place	NEVER	OFTEN	Zanzibar	1 YR TT	WALK	>2.5-3KM	-4.9839821	PARAFFIN/OIL	...	7.0		6.6	BOY	RURAL	NORTH PEMBA	No homework/Never/Sometimes	PERMANENT GOVT	OFTEN	OFTEN	OFTEN	A-LEVEL	OFTEN	1.0	16	✅	OFTEN	OFTEN	ALL THE TIME	OFTEN	7	26.0	OFTEN	17
70	5	OFTEN	OFTEN	No	ONCE	848.478480580758	2.0	OFTEN	679.756323867598	FEMALE	35.253304	524.863099306887	Salima	OFTEN	OFTEN	OFTEN	No place/share	NEVER	SOMETIMES	Malawi	1 YR TT	WALK	>1.5-2KM	-14.486174	PARAFFIN/OIL	...	12.0		4.8	BOY	LARGE CITY	Central eastern	No homework/Never/Sometimes	PERMANENT GOVT	OFTEN	OFTEN	OFTEN	SENIOR SEC	OFTEN	10.0	19	✅	SOMETIMES	OFTEN	NEVER	SOMETIMES	6	40.0	SOMETIMES	13
71	5	OFTEN	OFTEN	No	NEVER	683.414953384423	6.0	OFTEN	630.732236783727	FEMALE	39.240082	543.366353965001	URBAN	OFTEN	OFTEN	OFTEN	I have my own sitting place	NEVER	OFTEN	Zanzibar	1 YR TT	WALK	UP TO 0.5KM	-6.173358	ELECTRIC	...	30.0		1.8	BOY	LARGE CITY	URBAN WEST	Most of time/Always corrects	PERMANENT GOVT	OFTEN	OFTEN	OFTEN	SENIOR SEC	OFTEN	4.0	14	✅	OFTEN	OFTEN	ALL THE TIME	OFTEN	3	49.0	OFTEN	15
72	5	NEVER	SOMETIMES	One per day	NEVER	683.414953384423	8.0	SOMETIMES	657.247209953603	FEMALE	35.25	437.40183888683	Thyolo	SOMETIMES	SOMETIMES	SOMETIMES	No place/share	NEVER	NEVER	Malawi	1 YR TT	WALK	>0.5-1KM	-15.5	ELECTRIC	...	9.0		2.8	BOY	LARGE CITY	Southern western	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	SENIOR SEC	SOMETIMES	6.0	23	✅	NEVER	SOMETIMES	NEVER	NEVER	4	30.0	SOMETIMES	15
73	5	NEVER	SOMETIMES	No	NEVER	735.398150088381	12.0	SOMETIMES	740.607233516448	FEMALE	55.485935	398.773910347983	West	SOMETIMES	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	NEVER	Seychelles	1 YR TT	BUS/TRUCK/VAN	>3-3.5KM	-4.7047267	ELECTRIC	...	32.0		7.6	BOY	RURAL	West	Most of time/Always corrects	PERMANENT GOVT	NEVER	NEVER	SOMETIMES	A-LEVEL	SOMETIMES	0.0	98	✅	NEVER	NEVER	SOMETIMES	NEVER	2	53.0	SOMETIMES	11
74	5	NEVER	SOMETIMES	No	NEVER	735.398150088381	8.0	SOMETIMES	740.607233516448	FEMALE	55.485935	418.612451424724	West	SOMETIMES	SOMETIMES	SOMETIMES	I have my own sitting place	TWO YEARS	NEVER	Seychelles	1 YR TT	WALK	>1.5-2KM	-4.7047267	NO LIGHTING	...	32.0		7.6	GIRL	RURAL	West	Most of time/Always corrects	PERMANENT GOVT	NEVER	NEVER	SOMETIMES	A-LEVEL	SOMETIMES	0.0	98	✅	NEVER	NEVER	SOMETIMES	NEVER	0	53.0	SOMETIMES	11
75	5	NEVER	SOMETIMES	No	NEVER	656.860766323526	3.0	SOMETIMES	689.580216804638	FEMALE	39.287594	563.491027845734	WEST	OFTEN	SOMETIMES	SOMETIMES	I have my own sitting place	ONE YEAR	NEVER	Zanzibar	1 YR TT	WALK	>1-1.5KM	-6.1533532	PARAFFIN/OIL	...	11.0		5.4	GIRL	ISOLATED	URBAN WEST	No homework/Never/Sometimes	PERMANENT GOVT	NEVER	NEVER	NEVER	A-LEVEL	OFTEN	1.0	19	✅	OFTEN	SOMETIMES	ALL THE TIME	SOMETIMES	6	34.0	SOMETIMES	13
76	5	NEVER	NEVER	One per day	NEVER	803.746765127295	10.0	SOMETIMES	741.780846769329	FEMALE	57.493835	693.109188053866	Vacoas & West	NEVER	SOMETIMES	SOMETIMES	I have my own sitting place	TWO YEARS	NEVER	Mauritius	1 YR TT	BUS/TRUCK/VAN	>5KM	-20.298403	ELECTRIC	...	32.0		1.0	GIRL	LARGE CITY	4VA&W(G)	No homework/Never/Sometimes	PERMANENT GOVT	NEVER	SOMETIMES	NEVER	A-LEVEL	NEVER	0.0	23	✅	NEVER	NEVER	SOMETIMES	NEVER	2	58.0	SOMETIMES	11
77	5	NEVER	NEVER	No	THREE PLUS	722.458609783283	12.0	SOMETIMES	753.864720101386	FEMALE	55.693951	300.24884817359	Island	SOMETIMES	SOMETIMES	SOMETIMES	I have my own sitting place	TWO YEARS	NEVER	Seychelles	1 YR TT	WALK	>1-1.5KM	-4.3190727	ELECTRIC	...	38.0		2.0	BOY	SMALLTOWN	Island	Most of time/Always corrects	PERMANENT GOVT	NEVER	SOMETIMES	SOMETIMES	A-LEVEL	SOMETIMES	1.0	71	✅	NEVER	NEVER	NEVER	NEVER	2	58.0	SOMETIMES	11
78	5	NEVER	NEVER	No	ONCE	923.752849833893	4.0	SOMETIMES	684.334448731461	FEMALE	38.764359	583.329568922475	ARUSHA	NEVER	SOMETIMES	SOMETIMES	I have my own sitting place	ONE YEAR	NEVER	Tanzania	1 YR TT	WALK	>1-1.5KM	-5.192647	PARAFFIN/OIL	...	1.0		28.4	GIRL	RURAL	NORTHERN	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	SENIOR SEC	NEVER	5.0	25	✅	NEVER	NEVER	SOMETIMES	NEVER	9	22.0	SOMETIMES	17
79	5	NEVER	NEVER	No	ONCE	923.752849833893	4.0	SOMETIMES	684.334448731461	FEMALE	38.764359	443.792138175973	ARUSHA	NEVER	SOMETIMES	SOMETIMES	I have my own sitting place	A FEW MONTHS	NEVER	Tanzania	1 YR TT	WALK	>0.5-1KM	-5.192647	PARAFFIN/OIL	...	1.0		28.4	GIRL	RURAL	NORTHERN	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	SENIOR SEC	NEVER	5.0	25	✅	NEVER	NEVER	SOMETIMES	NEVER	6	22.0	SOMETIMES	16
80	5	NEVER	NEVER	No	ONCE	817.536101590307	5.0	SOMETIMES	734.97995503795	FEMALE	38.820545	517.042135997787	KAGERA	NEVER	NEVER	NEVER	I have my own sitting place	NEVER	NEVER	Tanzania	1 YR TT	WALK	UP TO 0.5KM	-7.3237715	PARAFFIN/OIL	...	3.0		2.0	BOY	SMALLTOWN	KAGERA	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	JUNIOR SEC	NEVER	15.0	22	❌	NEVER	NEVER	ALL THE TIME	NEVER	0	26.0	SOMETIMES	15
81	5	NEVER	NEVER	No	ONCE	817.536101590307	5.0	SOMETIMES	734.97995503795	FEMALE	38.820545	626.726377527847	KAGERA	NEVER	NEVER	NEVER	I have my own sitting place	NEVER	NEVER	Tanzania	1 YR TT	WALK	>3-3.5KM	-7.3237715	PARAFFIN/OIL	...	3.0		2.0	GIRL	SMALLTOWN	KAGERA	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	JUNIOR SEC	NEVER	15.0	22	❌	NEVER	NEVER	NEVER	NEVER	4	26.0	SOMETIMES	14
82	5	NEVER	NEVER	No	ONCE	817.536101590307	3.0	SOMETIMES	734.97995503795	FEMALE	38.820545	604.217263613852	KAGERA	NEVER	NEVER	NEVER	I have my own sitting place	NEVER	NEVER	Tanzania	1 YR TT	WALK	UP TO 0.5KM	-7.3237715	PARAFFIN/OIL	...	3.0		2.0	GIRL	SMALLTOWN	KAGERA	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	JUNIOR SEC	NEVER	15.0	22	❌	NEVER	NEVER	SOMETIMES	NEVER	2	26.0	SOMETIMES	17
83	5	NEVER	NEVER	No	ONCE	775.229430679726	4.0	OFTEN	649.235491441842	FEMALE	36.865391	489.954897219928	TANGA	NEVER	OFTEN	OFTEN	I have my own sitting place	ONE YEAR	NEVER	Tanzania	1 YR TT	WALK	>3-3.5KM	-7.9390264	PARAFFIN/OIL	...	3.0		5.2	BOY	RURAL	NORTHEAST	No homework/Never/Sometimes	PERMANENT GOVT	OFTEN	OFTEN	NEVER	JUNIOR SEC	SOMETIMES	1.0	25	✅	NEVER	NEVER	ALL THE TIME	NEVER	6	34.0	OFTEN	15
84	5	NEVER	NEVER	No	ONCE	696.467011431304	2.0	SOMETIMES	672.41224856515	FEMALE	31.262636	553.953267712685	KAGERA	NEVER	SOMETIMES	SOMETIMES	I have my own sitting place	ONE YEAR	NEVER	Tanzania	1 YR TT	WALK	UP TO 0.5KM	-1.3001115	PARAFFIN/OIL	...	1.0		4.4	GIRL	LARGE CITY	KAGERA	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	SOMETIMES	NEVER	SENIOR SEC	NEVER	3.0	23	❌	SOMETIMES	NEVER	NEVER	SOMETIMES	2	22.0	SOMETIMES	15
85	5	NEVER	NEVER	No	NEVER	848.478480580758	11.0	SOMETIMES	696.542781701763	FEMALE	39.208328	517.042135997787	DAR ES SALAAM	NEVER	SOMETIMES	OFTEN	I have my own sitting place	THREE OR MORE YEARS	NEVER	Tanzania	1 YR TT	WALK	UP TO 0.5KM	-6.7923541	ELECTRIC	...	1.0		3.0	BOY	LARGE CITY	EASTERN	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	OFTEN	NEVER	SENIOR SEC	NEVER	4.0	19	✅	NEVER	NEVER	ALL THE TIME	NEVER	0	32.0	SOMETIMES	14
86	5	NEVER	NEVER	No	NEVER	817.536101590307	5.0	SOMETIMES	734.97995503795	FEMALE	39.102322	583.329568922475	ARUSHA	SOMETIMES	SOMETIMES	SOMETIMES	I have my own sitting place	TWO YEARS	NEVER	Tanzania	1 YR TT	WALK	>3-3.5KM	-5.0888753	PARAFFIN/OIL	...	4.0		105.8	GIRL	RURAL	NORTHERN	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	NEVER	JUNIOR SEC	NEVER	0.0	25	✅	SOMETIMES	NEVER	SOMETIMES	SOMETIMES	7	27.0	SOMETIMES	14
87	5	NEVER	NEVER	No	NEVER	817.536101590307	4.0	SOMETIMES	734.97995503795	FEMALE	38.820545	695.97051609378	KAGERA	NEVER	NEVER	NEVER	I have my own sitting place	TWO YEARS	NEVER	Tanzania	1 YR TT	WALK	>4KM-4.5KM	-7.3237715	PARAFFIN/OIL	...	3.0		2.0	GIRL	SMALLTOWN	KAGERA	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	JUNIOR SEC	NEVER	15.0	22	✅	NEVER	NEVER	SOMETIMES	NEVER	3	26.0	SOMETIMES	13
88	5	NEVER	NEVER	No	NEVER	803.02131290024	3.0	NEVER	615.471820570849	FEMALE	31.707684	404.01967842116	KILIMANJARO	NEVER	NEVER	NEVER	I have my own sitting place	ONE YEAR	NEVER	Tanzania	1 YR TT	WALK	UP TO 0.5KM	-1.5407997	PARAFFIN/OIL	...	3.0		6.4	BOY	RURAL	KILIMANJARO	No homework/Never/Sometimes	PERMANENT GOVT	NEVER	NEVER	NEVER	SENIOR SEC	SOMETIMES	1.0	25	✅	NEVER	NEVER	SOMETIMES	NEVER	2	30.0	NEVER	14
89	5	NEVER	NEVER	No	NEVER	788.956595177308	9.0	SOMETIMES	846.094860587967	FEMALE	55.463776	388.47312940429	West	SOMETIMES	SOMETIMES	OFTEN	I have my own sitting place	TWO YEARS	NEVER	Seychelles	1 YR TT	WALK	>1.5-2KM	-4.677392	ELECTRIC	...	2.0		3.8	BOY	ISOLATED	West	No homework/Never/Sometimes	PERMANENT GOVT	NEVER	NEVER	NEVER	TERTIARY ED	SOMETIMES	0.0	41	✅	NEVER	NEVER	NEVER	NEVER	3	32.0	SOMETIMES	11
90	5	NEVER	NEVER	No	NEVER	788.956595177308	7.0	SOMETIMES	846.094860587967	FEMALE	55.463776	428.150211557773	West	SOMETIMES	SOMETIMES	OFTEN	I have my own sitting place	TWO YEARS	NEVER	Seychelles	1 YR TT	WALK	UP TO 0.5KM	-4.677392	CANDLE	...	2.0		3.8	BOY	ISOLATED	West	No homework/Never/Sometimes	PERMANENT GOVT	NEVER	NEVER	NEVER	TERTIARY ED	SOMETIMES	0.0	41	✅	NEVER	NEVER	SOMETIMES	NEVER	2	32.0	SOMETIMES	12
91	5	NEVER	NEVER	No	NEVER	775.229430679726	5.0	OFTEN	649.235491441842	FEMALE	36.865391	498.920391744994	TANGA	NEVER	OFTEN	OFTEN	I have my own sitting place	A FEW MONTHS	NEVER	Tanzania	1 YR TT	WALK	>4KM-4.5KM	-7.9390264	PARAFFIN/OIL	...	3.0		5.2	GIRL	RURAL	NORTHEAST	Most of time/Always corrects	PERMANENT GOVT	OFTEN	OFTEN	NEVER	JUNIOR SEC	SOMETIMES	1.0	25	✅	NEVER	NEVER	ALL THE TIME	NEVER	6	34.0	OFTEN	14
92	5	NEVER	NEVER	No	NEVER	775.229430679726	2.0	SOMETIMES	709.037247476057	FEMALE	37.355629	424.430485105884	MWANZA	NEVER	OFTEN	SOMETIMES	I have my own sitting place	NEVER	NEVER	Tanzania	1 YR TT	WALK	>3.5-4KM	-3.0674248	PARAFFIN/OIL	...	3.0		13.8	BOY	RURAL	MWANZA	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	NEVER	NEVER	SENIOR SEC	NEVER	2.0	17	✅	NEVER	NEVER	SOMETIMES	NEVER	9	24.0	SOMETIMES	15
93	4	SOMETIMES	SOMETIMES	No	ONCE	883.133945050064	4.0	SOMETIMES	721.817846054342	FEMALE	36.559589	626.726377527847	DODOMA	SOMETIMES	SOMETIMES	OFTEN	I have my own sitting place	A FEW MONTHS	OFTEN	Tanzania	1 YR TT	WALK	UP TO 0.5KM	-6.5385022	PARAFFIN/OIL	...	1.0		42.0	BOY	RURAL	CENTRAL	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	JUNIOR SEC	OFTEN	0.0	25	❌	SOMETIMES	SOMETIMES	SOMETIMES	OFTEN	3	25.0	SOMETIMES	17
94	4	SOMETIMES	SOMETIMES	No	NEVER	883.133945050064	5.0	SOMETIMES	721.817846054342	FEMALE	36.559589	626.726377527847	DODOMA	SOMETIMES	SOMETIMES	OFTEN	I have my own sitting place	NEVER	OFTEN	Tanzania	1 YR TT	WALK	UP TO 0.5KM	-6.5385022	PARAFFIN/OIL	...	1.0		42.0	BOY	RURAL	CENTRAL	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	JUNIOR SEC	OFTEN	0.0	25	✅	SOMETIMES	SOMETIMES	ALL THE TIME	OFTEN	1	25.0	SOMETIMES	13
95	4	SOMETIMES	SOMETIMES	No	NEVER	832.61347898929	3.0	SOMETIMES	684.334448731461	FEMALE	29.661505	615.185687766858	TABORA	SOMETIMES	SOMETIMES	SOMETIMES	I have my own sitting place	NEVER	OFTEN	Tanzania	1 YR TT	WALK	>2-2.5KM	-4.8824091	PARAFFIN/OIL	...	5.0		9.4	BOY	SMALLTOWN	WESTERN	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	OFTEN	SENIOR SEC	SOMETIMES	0.0	25	✅	OFTEN	SOMETIMES	ALL THE TIME	SOMETIMES	2	26.0	SOMETIMES	16
96	4	OFTEN	SOMETIMES	No	NEVER	923.752849833893	8.0	SOMETIMES	777.327610028686	FEMALE	36.026806	626.726377527847	DODOMA	SOMETIMES	SOMETIMES	SOMETIMES	I have my own sitting place	ONE YEAR	SOMETIMES	Tanzania	1 YR TT	WALK	>0.5-1KM	-6.1395359	PARAFFIN/OIL	...	2.0		7.6	GIRL	RURAL	CENTRAL	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	A-LEVEL	OFTEN	0.0	24	❌	SOMETIMES	SOMETIMES	ALL THE TIME	OFTEN	0	25.0	SOMETIMES	13
97	4	OFTEN	SOMETIMES	No	NEVER	923.752849833893	5.0	SOMETIMES	777.327610028686	FEMALE	36.026806	665.258928465364	DODOMA	SOMETIMES	SOMETIMES	SOMETIMES	I have my own sitting place	TWO YEARS	SOMETIMES	Tanzania	1 YR TT	WALK	>0.5-1KM	-6.1395359	PARAFFIN/OIL	...	2.0		7.6	GIRL	RURAL	CENTRAL	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	A-LEVEL	OFTEN	0.0	24	❌	SOMETIMES	SOMETIMES	ALL THE TIME	OFTEN	0	25.0	SOMETIMES	14
98	4	OFTEN	SOMETIMES	No	NEVER	923.752849833893	5.0	SOMETIMES	777.327610028686	FEMALE	36.026806	679.947079070258	DODOMA	SOMETIMES	SOMETIMES	SOMETIMES	I have my own sitting place	ONE YEAR	SOMETIMES	Tanzania	1 YR TT	WALK	UP TO 0.5KM	-6.1395359	PARAFFIN/OIL	...	2.0		7.6	BOY	RURAL	CENTRAL	Most of time/Always corrects	PERMANENT GOVT	SOMETIMES	SOMETIMES	SOMETIMES	A-LEVEL	OFTEN	0.0	24	✅	SOMETIMES	SOMETIMES	ALL THE TIME	OFTEN	1	25.0	SOMETIMES	13
99	4	OFTEN	OFTEN	No	ONCE	600.039306722879	10.0	OFTEN	552.808736496719	FEMALE	39.204594	632.353656006346	WEST	OFTEN	OFTEN	OFTEN	No place/share	NEVER	OFTEN	Zanzibar	1 YR TT	WALK	>2.5-3KM	-6.2066731	ELECTRIC	...	29.0		0.8	GIRL	LARGE CITY	URBAN WEST	No homework/Never/Sometimes	PERMANENT GOVT	SOMETIMES	OFTEN	OFTEN	A-LEVEL	OFTEN	5.0	10	✅	OFTEN	OFTEN	ALL THE TIME	OFTEN	4	48.0	OFTEN	14
100	4	OFTEN	OFTEN	No	NEVER	848.478480580758	11.0	OFTEN	679.756323867598	FEMALE	35.253304	490.431785226581	Salima	OFTEN	OFTEN	OFTEN	No place/share	THREE OR MORE YEARS	SOMETIMES	Malawi	1 YR TT	WALK	>2.5-3KM	-14.486174	ELECTRIC	...	12.0		4.8	BOY	LARGE CITY	Central eastern	No homework/Never/Sometimes	PERMANENT GOVT	OFTEN	OFTEN	OFTEN	SENIOR SEC	OFTEN	10.0	19	✅	SOMETIMES	OFTEN	NEVER	SOMETIMES	12	40.0	SOMETIMES	12

Rows: 1-100 of 56217 | Columns: 59

Now that we have a clean dataset, we can use a Random Forest Regressor to understand what tends to influence the a student's final score.

Machine Learning: Finding Clusters using lat/long¶

Let's try to find some clusters between schools.

Since we have the school's location, a natural approach might be to find school clusters based on proximity. These clusters can be used as inputs by our model.

In [9]:

from verticapy.learn.model_selection import elbow
elbow(africa,
      X = ["lon", "lat"],
      n_cluster = (1, 30))

Out[9]:

	Within-Cluster SS
1	0.0
2	0.5683130587090786
3	0.7660416833926682
4	0.836131895099768
5	0.8935216323048262
6	0.9155314811451387
7	0.9138344588898135
8	0.9438393221976537
9	0.940454778341179
10	0.956045865392335
11	0.9625834281544269
12	0.9455103246433446
13	0.9516470625089978
14	0.9763978072832529
15	0.9737141720488015
16	0.9809605178489903
17	0.980305315076785
18	0.9814431681994104
19	0.9823013083684672
20	0.9830145421634753
21	0.9857334410872993
22	0.9835292893185429
23	0.985804139649003
24	0.965912936689866
25	0.9863324958492412
26	0.987597709092708
27	0.9881249526037185
28	0.9890061168806425
29	0.9895934456099531

Rows: 1-29 | Columns: 2

Eight seems to be a suitable number of clusters. Let's compute a k-means model.

In [10]:

from verticapy.learn.cluster import KMeans
model = KMeans(name = "kmeans_africa",
               n_cluster = 8)
model.fit(africa, 
          X = ["lon", "lat"])

Out[10]:


=======
centers
=======
  lon   |   lat   
--------+---------
38.66529|-5.42544 
33.83879| 0.11047 
28.35561|-19.33987
57.91915|-20.21206
28.45044|-27.76424
34.50942|-13.54691
16.87065|-20.22396
55.50771|-4.61916 


=======
metrics
=======
Evaluation metrics:
     Total Sum of Squares: 11683406
     Within-Cluster Sum of Squares: 
         Cluster 0: 33105.114
         Cluster 1: 72997.563
         Cluster 2: 98589.879
         Cluster 3: 7951.0122
         Cluster 4: 294938.41
         Cluster 5: 73325.35
         Cluster 6: 70857.018
         Cluster 7: 39.790598
     Total Within-Cluster Sum of Squares: 651804.14
     Between-Cluster Sum of Squares: 11031602
     Between-Cluster SS / Total SS: 94.42%
 Number of iterations performed: 14
 Converged: True
 Call:
kmeans('public.kmeans_africa', '"public"."_verticapy_tmp_view_dbadmin_51429_5275640297_"', '"lon", "lat"', 8
USING PARAMETERS max_iterations=300, epsilon=0.0001, init_method='kmeanspp', distance_method='euclidean')

We can add the prediction to the vDataFrame and draw the scatter map.

In [11]:

# Adding the prediction to the vDataFrame
model.predict(africa,
              name = "clusters")

# Importing the World Data
from verticapy.datasets import load_world
africa_world = load_world()
# Filtering and drawing Africa
africa_world = africa_world[africa_world["continent"] == "Africa"]
ax = africa_world["geometry"].geo_plot(color = "white",
                                       edgecolor='black',)

# displaying the clusters
africa.scatter(["lon", "lat"],
               catcol = "clusters",
               ax = ax,
               with_others = False)

Out[11]:

<AxesSubplot:xlabel='"lon"', ylabel='"lat"'>

Machine Learning: Understanding the Students' Final Scores¶

A student's math score is strongly correlated their reading score, so we can use just one of the variables for our predictions. Let's use a cross validation to see if our variables have enough information to predict the students' scores.

In [12]:

from verticapy.learn.ensemble import RandomForestRegressor
from verticapy.learn.model_selection import cross_validate
predictors = africa.get_columns(exclude_columns = ["zralocp", 
                                                   "zmalocp",
                                                   "lat", 
                                                   "lon",
                                                   "schoolname"])
response = "zralocp"
model = RandomForestRegressor(name = "africa_rf",
                              n_estimators = 40,
                              max_depth = 20,
                              min_samples_leaf = 4,
                              nbins = 20,
                              sample = 0.7)
cross_validate(model, 
               africa,
               X = predictors, 
               y = response)

Out[12]:

	explained_variance	max_error	median_absolute_error	mean_absolute_error	mean_squared_error	root_mean_squared_error	r2	r2_adj	aic	bic	time
1-fold	0.497755953807835	448.174443358291	45.8194163858715	56.4336929005632	5262.90961240406	72.5459138229305	0.497741760266202	0.49626358158547856	160719.1680741505	161157.78966917138	22.508830070495605
2-fold	0.498345534539006	435.008751165662	46.2120984306739	56.6372306882844	5296.38254210606	72.77624984915106	0.49821813273793	0.4967377914463238	160452.1410933166	160890.62725901676	23.343525886535645
3-fold	0.491764857867918	405.116142035736	45.0706183304264	55.9740749407522	5198.58947623192	72.10124462332062	0.491764036404225	0.4902702631985516	160702.5818786396	161141.2785708916	23.810549020767212
avg	0.495955448738253	429.433112186563	45.7007110489906	56.348332843199934	5252.627210247347	72.47446943180073	0.49590797646945234	0.49442387874345134	160624.63034870225	161063.23183302657	23.22096832593282
std	0.003641111127326824	22.064001013300405	0.5799244972996622	0.33971847302735986	49.700772417038365	0.3431271477055207	0.003596652906676178	0.003604942484860909	149.61010289415754	149.70774301429267	0.6594568394669506

Rows: 1-5 | Columns: 12

These scores are quite good! Let's fit all the data and keep the most important variables.

In [13]:

model.fit(africa, 
          X = predictors, 
          y = response)
predictors = model.features_importance()["index"]

We can see here that socioeconomic status and a student's country tend to strongly influence the students work quality. This makes sense: you would expect that having poor studying conditions (unstable government, difficulties at home, etc.) would lead to worse results. For now, let's just consider the 20 most important variables.

Let's do some tuning to find the best parameters for the use case. Our goal will be to optimize the 'median_absolute_error'.

In [14]:

from verticapy.learn.model_selection import grid_search_cv
gcv = grid_search_cv(model,
                     {"min_samples_leaf": [1, 3, 5],
                      "max_leaf_nodes": [5000, 10000, 1e9],
                      "max_depth": [15, 20, 25, 30]},
                     metric = "median",
                     input_relation = africa,
                     X = predictors, 
                     y = response)
display(gcv)

Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 1, 'max_leaf_nodes': 5000, 'max_depth': 15}; Test_score: 44.815773776694165; Train_score: 34.437364422325935; Time: 34.0726965268453;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 1, 'max_leaf_nodes': 5000, 'max_depth': 20}; Test_score: 44.43462167698913; Train_score: 31.466594928324632; Time: 47.30741548538208;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 1, 'max_leaf_nodes': 5000, 'max_depth': 25}; Test_score: 44.39498782850767; Train_score: 31.399951881376868; Time: 45.235618591308594;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 1, 'max_leaf_nodes': 5000, 'max_depth': 30}; Test_score: 44.27196510370816; Train_score: 31.4873298968226; Time: 46.80940135320028;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 1, 'max_leaf_nodes': 10000, 'max_depth': 15}; Test_score: 44.677988972014305; Train_score: 34.48031567803756; Time: 43.878964026769005;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 1, 'max_leaf_nodes': 10000, 'max_depth': 20}; Test_score: 43.76708560192003; Train_score: 25.108482227548333; Time: 65.75791295369466;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 1, 'max_leaf_nodes': 10000, 'max_depth': 25}; Test_score: 43.6429162784452; Train_score: 24.501555900266666; Time: 85.19987908999126;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 1, 'max_leaf_nodes': 10000, 'max_depth': 30}; Test_score: 44.14526541409577; Train_score: 24.341936902451966; Time: 74.4509600798289;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 1, 'max_leaf_nodes': 1000000000.0, 'max_depth': 15}; Test_score: 44.41757533622194; Train_score: 34.747869803922036; Time: 44.308852434158325;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 1, 'max_leaf_nodes': 1000000000.0, 'max_depth': 20}; Test_score: 43.820256162195996; Train_score: 24.982454040841933; Time: 66.08455030123393;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 1, 'max_leaf_nodes': 1000000000.0, 'max_depth': 25}; Test_score: 43.803032629800335; Train_score: 18.841214722947367; Time: 88.7827734152476;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 1, 'max_leaf_nodes': 1000000000.0, 'max_depth': 30}; Test_score: 43.76385623303604; Train_score: 15.805628343811366; Time: 110.55435840288798;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 3, 'max_leaf_nodes': 5000, 'max_depth': 15}; Test_score: 45.42017880248803; Train_score: 40.861483096530364; Time: 31.150578657786053;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 3, 'max_leaf_nodes': 5000, 'max_depth': 20}; Test_score: 44.572706381380435; Train_score: 39.4274053890024; Time: 32.411439657211304;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 3, 'max_leaf_nodes': 5000, 'max_depth': 25}; Test_score: 45.3606339832735; Train_score: 38.70245113491857; Time: 31.84687892595927;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 3, 'max_leaf_nodes': 5000, 'max_depth': 30}; Test_score: 44.414369616618835; Train_score: 38.6370794085203; Time: 33.693460861841835;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 3, 'max_leaf_nodes': 10000, 'max_depth': 15}; Test_score: 45.3705477457467; Train_score: 40.9302856468402; Time: 30.465041716893513;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 3, 'max_leaf_nodes': 10000, 'max_depth': 20}; Test_score: 44.908553612914865; Train_score: 39.1255041348845; Time: 31.914735158284504;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 3, 'max_leaf_nodes': 10000, 'max_depth': 25}; Test_score: 44.64404097708807; Train_score: 38.87412589886093; Time: 31.960539658864338;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 3, 'max_leaf_nodes': 10000, 'max_depth': 30}; Test_score: 45.4372279297805; Train_score: 38.54273183891793; Time: 33.43163243929545;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 3, 'max_leaf_nodes': 1000000000.0, 'max_depth': 15}; Test_score: 45.40760390269104; Train_score: 40.76403746893224; Time: 28.992387930552166;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 3, 'max_leaf_nodes': 1000000000.0, 'max_depth': 20}; Test_score: 44.81764453733027; Train_score: 39.148799077799; Time: 30.873204708099365;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 3, 'max_leaf_nodes': 1000000000.0, 'max_depth': 25}; Test_score: 45.0271995994772; Train_score: 38.67575019644633; Time: 30.93468515078227;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 3, 'max_leaf_nodes': 1000000000.0, 'max_depth': 30}; Test_score: 44.78288151067963; Train_score: 38.5948139329779; Time: 31.021547476450603;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 5, 'max_leaf_nodes': 5000, 'max_depth': 15}; Test_score: 46.0300887776835; Train_score: 42.896831181553836; Time: 30.873554786046345;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 5, 'max_leaf_nodes': 5000, 'max_depth': 20}; Test_score: 45.429015441785836; Train_score: 42.134447174417964; Time: 37.08091505368551;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 5, 'max_leaf_nodes': 5000, 'max_depth': 25}; Test_score: 45.4153834187961; Train_score: 42.13894361732096; Time: 36.69696195920309;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 5, 'max_leaf_nodes': 5000, 'max_depth': 30}; Test_score: 45.7834255442763; Train_score: 42.16673215684126; Time: 30.52557873725891;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 5, 'max_leaf_nodes': 10000, 'max_depth': 15}; Test_score: 45.949493606361365; Train_score: 43.009506264296796; Time: 30.12321464220683;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 5, 'max_leaf_nodes': 10000, 'max_depth': 20}; Test_score: 45.37640425132127; Train_score: 42.2442381856835; Time: 30.370788097381592;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 5, 'max_leaf_nodes': 10000, 'max_depth': 25}; Test_score: 45.6699668404338; Train_score: 42.11806326507703; Time: 28.4678795337677;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 5, 'max_leaf_nodes': 10000, 'max_depth': 30}; Test_score: 45.383495050063765; Train_score: 42.1232547703439; Time: 30.701225121815998;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 5, 'max_leaf_nodes': 1000000000.0, 'max_depth': 15}; Test_score: 45.853593489891466; Train_score: 42.973320884057; Time: 25.365408817927044;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 5, 'max_leaf_nodes': 1000000000.0, 'max_depth': 20}; Test_score: 45.57095430429107; Train_score: 42.24949161547043; Time: 28.194523334503174;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 5, 'max_leaf_nodes': 1000000000.0, 'max_depth': 25}; Test_score: 45.77750590704737; Train_score: 42.03886046045277; Time: 29.33542521794637;
Model: RandomForestRegressor; Parameters: {'min_samples_leaf': 5, 'max_leaf_nodes': 1000000000.0, 'max_depth': 30}; Test_score: 45.44398933494437; Train_score: 42.14078195551326; Time: 28.64320206642151;

Grid Search Selected Model
RandomForestRegressor; Parameters: {'n_estimators': 40, 'max_features': 'auto', 'max_leaf_nodes': 10000, 'sample': 0.7, 'max_depth': 25, 'min_samples_leaf': 1, 'min_info_gain': 0.0, 'nbins': 20}; Test_score: 43.6429162784452; Train_score: 24.501555900266666; Time: 85.19987908999126;

	avg_score	avg_train_score	avg_time	score_std	score_train_std
1	43.6429162784452	24.501555900266666	85.19987908999126	0.1886395885572538	0.033107002733325064
2	43.76385623303604	15.805628343811366	110.55435840288798	0.4915136834667504	0.1897662632452654
3	43.76708560192003	25.108482227548333	65.75791295369466	0.2918238784471277	0.16734703642407173
4	43.803032629800335	18.841214722947367	88.7827734152476	0.2215455243078192	0.19307466396781162
5	43.820256162195996	24.982454040841933	66.08455030123393	0.06634735885262172	0.36032133838644054
6	44.14526541409577	24.341936902451966	74.4509600798289	0.4550178218056465	0.05689181564961146
7	44.27196510370816	31.4873298968226	46.80940135320028	0.3883995397152761	0.2548608042481261
8	44.39498782850767	31.399951881376868	45.235618591308594	0.347386821042444	0.16264442585392802
9	44.414369616618835	38.6370794085203	33.693460861841835	0.425998569433185	0.3020900345590051
10	44.41757533622194	34.747869803922036	44.308852434158325	0.3391009878727135	0.1428352575657341
11	44.43462167698913	31.466594928324632	47.30741548538208	0.3177709041324224	0.05116773522014846
12	44.572706381380435	39.4274053890024	32.411439657211304	0.16300093141541303	0.1279549233340166
13	44.64404097708807	38.87412589886093	31.960539658864338	0.27065591988587334	0.17281411441358477
14	44.677988972014305	34.48031567803756	43.878964026769005	0.1657346138787724	0.16644170022258253
15	44.78288151067963	38.5948139329779	31.021547476450603	0.25806398706008526	0.1643307526113933
16	44.815773776694165	34.437364422325935	34.0726965268453	0.26683319564827274	0.18077804288890037
17	44.81764453733027	39.148799077799	30.873204708099365	0.5390264337672513	0.3195580375117262
18	44.908553612914865	39.1255041348845	31.914735158284504	0.5750369326363028	0.30108463924593376
19	45.0271995994772	38.67575019644633	30.93468515078227	0.529225658449466	0.15582573215596704
20	45.3606339832735	38.70245113491857	31.84687892595927	0.5438355854413984	0.21712837774209637
21	45.3705477457467	40.9302856468402	30.465041716893513	0.2555198478832409	0.24522372700501233
22	45.37640425132127	42.2442381856835	30.370788097381592	0.2102603785321443	0.20443787596321408
23	45.383495050063765	42.1232547703439	30.701225121815998	0.4707225795865007	0.2721765303839384
24	45.40760390269104	40.76403746893224	28.992387930552166	0.2927281277315196	0.15752948626749735
25	45.4153834187961	42.13894361732096	36.69696195920309	0.5340267355072563	0.2761415425254518
26	45.42017880248803	40.861483096530364	31.150578657786053	0.3324324038317431	0.04227189177200773
27	45.429015441785836	42.134447174417964	37.08091505368551	0.396464488659363	0.07498742921804988
28	45.4372279297805	38.54273183891793	33.43163243929545	0.16399068079126977	0.04185734175517175
29	45.44398933494437	42.14078195551326	28.64320206642151	0.349577783125631	0.17683878772205122
30	45.57095430429107	42.24949161547043	28.194523334503174	0.03339678091052915	0.1485717719543109
31	45.6699668404338	42.11806326507703	28.4678795337677	0.2884693345634251	0.16484478456125043
32	45.77750590704737	42.03886046045277	29.33542521794637	0.2242170428572223	0.26084445965166536
33	45.7834255442763	42.16673215684126	30.52557873725891	0.0798474800843496	0.17282646857872178
34	45.853593489891466	42.973320884057	25.365408817927044	0.19626466372379145	0.1352515150027249
35	45.949493606361365	43.009506264296796	30.12321464220683	0.30554704180836967	0.1358634323152667
36	46.0300887776835	42.896831181553836	30.873554786046345	0.15978951555548682	0.16489032708534934

Rows: 1-36 | Columns: 6

Our model is excellent. Let's create one for the students' standardized reading score (zralocp).

In [15]:

response = "zralocp"
model_africa_rf_zralocp = RandomForestRegressor(name = "africa_rf_zralocp",
                                                **gcv["parameters"][0])
model_africa_rf_zralocp.fit(africa,
                            predictors[0:20], 
                            response)
model_africa_rf_zralocp.regression_report()

Out[15]:

	value
explained_variance	0.787483818752704
max_error	322.763142472485
median_absolute_error	30.0902958582632
mean_absolute_error	36.618536318738
mean_squared_error	2195.25759005393
root_mean_squared_error	46.85357606473523
r2	0.787482708506346
r2_adj	0.7874070741937638
aic	432578.68792303384
bic	432766.34794439597

Rows: 1-10 | Columns: 2

We'll also create one for the students' standardized mathematics score (zmalocp).

In [16]:

response = "zmalocp"
model_africa_rf_zmalocp = RandomForestRegressor(name = "africa_rf_zmalocp",
                                                **gcv["parameters"][0])
model_africa_rf_zmalocp.drop()
model_africa_rf_zmalocp.fit(africa,
                            predictors[0:20], 
                            response)
model_africa_rf_zmalocp.regression_report()

Out[16]:

	value
explained_variance	0.769507511675749
max_error	301.938698792704
median_absolute_error	29.3989228641815
mean_absolute_error	36.0445871912424
mean_squared_error	2136.32034742698
root_mean_squared_error	46.22034560047101
r2	0.769506447673683
r2_adj	0.7694244156599004
aic	431048.7699548158
bic	431236.4299761779

Rows: 1-10 | Columns: 2

Let's look at the feature importance for each model.

In [19]:

model_africa_rf_zralocp.features_importance()
model_africa_rf_zmalocp.features_importance()

Feature importance between between math score and the reading score are almost identical.

We can add these predictions to the main vDataFrame.

In [17]:

africa = africa.select(predictors[0:20] + ["zralocp", "zmalocp"])
model_africa_rf_zralocp.predict(africa, name = "pred_zralocp")
model_africa_rf_zmalocp.predict(africa, name = "pred_zmalocp")

Out[17]:

	123 zpses Numeric(7,3)	Abc country_long Varchar(24)	Abc PLIGHT Varchar(24)	Abc PREPEAT Varchar(20)	123 clusters Integer	Abc PENGLISH Varchar(32)	123 PAGE Integer	Abc SLOCAT Varchar(20)	Abc PTRAVEL2 Varchar(26)	123 zmaloct Float	Abc district Varchar(46)	Abc province Varchar(44)	Abc REGION Varchar(20)	Abc SPUPPR04 Varchar(20)	Abc PNURSERY Varchar(38)	123 PABSENT Integer	Abc Varchar(68)	123 XAGE Numeric(7,3)	123 zraloct Float	Abc zpmealsc Varchar(38)	123 zralocp Float	123 zmalocp Float	123 pred_zralocp Float	123 pred_zmalocp Float
1	4.0	Tanzania	PARAFFIN/OIL	ONCE	1	MOST OF THE TIME	16	RURAL	WALK	803.02131290024	KAGERA	KAGERA	KAG	SOMETIMES	ONE YEAR	25		26.0	777.327610028686	No	626.726377527847	578.323382558671	621.137846199889	566.24188444521
2	3.0	Tanzania	FIRE	NEVER	0	SOMETIMES	15	RURAL	WALK	865.243624106494	ARUSHA	NORTHERN	NOR	OFTEN	ONE YEAR	24		23.0	777.327610028686	No	443.792138175973	486.058834296235	489.921974499902	512.218817441847
3	11.0	Mauritius	ELECTRIC	ONCE	3	SOMETIMES	12	LARGE CITY	BUS/TRUCK/VAN	803.746765127295	Vacoas & West	4VA&W(G)	4VA	NEVER	THREE OR MORE YEARS	22		58.0	741.780846769329	One per day	464.393700063358	509.350006845411	489.288981714929	558.796507607588
4	4.0	Tanzania	FIRE	NEVER	0	SOMETIMES	15	RURAL	WALK	865.243624106494	ARUSHA	NORTHERN	NOR	OFTEN	NEVER	18		23.0	777.327610028686	No	535.35463545324	513.288127807832	535.859140950588	520.587365533089
5	9.0	Mauritius	ELECTRIC	NEVER	3	NEVER	11	LARGE CITY	WALK	803.746765127295	Port Louis & North	1PL&N(G)	1PL	NEVER	TWO YEARS	17		49.0	741.780846769329	One per day	408.883936089015	423.836523089981	422.831070751325	427.873565900387
6	1.0	Tanzania	FIRE	NEVER	0	NEVER	14	RURAL	WALK	865.243624106494	ARUSHA	NORTHERN	NOR	OFTEN	NEVER	16		23.0	777.327610028686	No	626.726377527847	539.729797126945	606.735589954982	545.006544745666
7	2.0	Tanzania	FIRE	NEVER	1	ALL THE TIME	13	SMALLTOWN	WALK	761.727301665711	TABORA	WESTERN	WES	SOMETIMES	NEVER	15		31.0	734.97995503795	No	679.947079070258	656.635730839959	632.958209960239	619.631984933216
8	7.0	Tanzania	PARAFFIN/OIL	NEVER	0	ALL THE TIME	15	RURAL	BICYCLE	923.752849833893	ARUSHA	NORTHERN	NOR	SOMETIMES	ONE YEAR	14		22.0	684.334448731461	No	453.234520707691	526.56522133828	499.11615917431	544.286562923076
9	1.0	Tanzania	FIRE	NEVER	0	SOMETIMES	17	RURAL	WALK	865.243624106494	ARUSHA	NORTHERN	NOR	OFTEN	NEVER	14		23.0	777.327610028686	No	517.042135997787	539.729797126945	531.957680093107	549.329326503956
10	3.0	Tanzania	PARAFFIN/OIL	ONCE	1	ALL THE TIME	14	SMALLTOWN	WALK	761.727301665711	TABORA	WESTERN	WES	SOMETIMES	NEVER	12		31.0	734.97995503795	No	563.586405447064	565.496359995357	537.287241131914	557.747474089496
11	1.0	Zanzibar	PARAFFIN/OIL	ONCE	0	ALL THE TIME	14	RURAL	WALK	629.181401844795	MKOANI	SOUTH PEMBA	SOP	OFTEN	NEVER	12		50.0	702.170060180262	No	373.021957988751	468.618584319798	402.932692212603	460.377246784354
12	6.0	Lesotho	CANDLE	THREE PLUS	4	ALL THE TIME	14	RURAL	WALK	817.536101590307	QACHA'S NEK	QACHA'S NEK	QNK	OFTEN	TWO YEARS	11		25.0	727.826634938163	One per day	455.523583139623	439.363971456099	448.605474757921	455.000665300745
13	3.0	Lesotho	CANDLE	ONCE	4	SOMETIMES	16	RURAL	WALK	817.536101590307	QACHA'S NEK	QACHA'S NEK	QNK	OFTEN	NEVER	10		25.0	727.826634938163	One per day	473.168439385763	535.116569713823	447.426082453539	459.735891380055
14	5.0	Tanzania	PARAFFIN/OIL	ONCE	0	NEVER	18	RURAL	WALK	865.243624106494	ARUSHA	NORTHERN	NOR	OFTEN	TWO YEARS	10		23.0	777.327610028686	No	424.430485105884	426.536948892784	494.107050513435	486.452042126363
15	4.0	Tanzania	PARAFFIN/OIL	ONCE	1	SOMETIMES	17	LARGE CITY	WALK	696.467011431304	KAGERA	KAGERA	KAG	SOMETIMES	ONE YEAR	10		22.0	672.41224856515	No	573.314920782774	656.635730839959	567.851373853226	564.475097882755
16	3.0	Tanzania	PARAFFIN/OIL	ONCE	1	SOMETIMES	15	LARGE CITY	WALK	696.467011431304	KAGERA	KAGERA	KAG	SOMETIMES	TWO YEARS	10		22.0	672.41224856515	No	517.042135997787	442.176915000685	537.069147188824	465.788912744232
17	1.0	Tanzania	FIRE	NEVER	0	NEVER	16	RURAL	WALK	865.243624106494	ARUSHA	NORTHERN	NOR	OFTEN	ONE YEAR	10		23.0	777.327610028686	No	626.726377527847	699.392472717674	596.173196198974	625.757985061903
18	6.0	Mozambique	PARAFFIN/OIL	NEVER	4	SOMETIMES	13	LARGE CITY	WALK	846.115608003305	Matutuine	Maputo	MAP	OFTEN	NEVER	10		46.0	882.719859498874	No	577.225402437324	546.480861633952	496.978911696208	492.208393310343
19	5.0	Malawi	CANDLE	TWICE	5	NEVER	13	LARGE CITY	WALK	848.478480580758	Salima	Central eastern	CEA	OFTEN	THREE OR MORE YEARS	9		40.0	679.756323867598	No	490.431785226581	372.303397353157	445.205155758312	420.835142902145
20	5.0	Tanzania	PARAFFIN/OIL	TWICE	0	MOST OF THE TIME	16	SMALLTOWN	WALK	817.536101590307	KAGERA	KAGERA	KAG	SOMETIMES	ONE YEAR	9		26.0	734.97995503795	No	615.185687766858	526.56522133828	609.257926212806	560.635332229419
21	3.0	Tanzania	PARAFFIN/OIL	ONCE	0	SOMETIMES	16	SMALLTOWN	WALK	817.536101590307	KAGERA	KAGERA	KAG	SOMETIMES	ONE YEAR	9		26.0	734.97995503795	No	665.258928465364	603.9774276853	629.167949286224	593.431427632948
22	4.0	Tanzania	PARAFFIN/OIL	ONCE	0	MOST OF THE TIME	13	RURAL	WALK	775.229430679726	TANGA	NORTHEAST	NOE	OFTEN	ONE YEAR	9		34.0	649.235491441842	No	517.042135997787	552.669337432043	512.14666760662	529.498214812869
23	4.0	Tanzania	FIRE	NEVER	0	SOMETIMES	16	RURAL	WALK	775.229430679726	MWANZA	MWANZA	MWA	SOMETIMES	NEVER	9		24.0	709.037247476057	No	573.314920782774	578.323382558671	561.167626188986	534.430412049653
24	5.0	Tanzania	PARAFFIN/OIL	NEVER	0	SOMETIMES	14	RURAL	WALK	761.727301665711	ARUSHA	NORTHERN	NOR	NEVER	ONE YEAR	8		23.0	684.334448731461	No	626.726377527847	486.058834296235	592.212163455429	500.395119479964
25	5.0	Tanzania	PARAFFIN/OIL	ONCE	1	SOMETIMES	15	LARGE CITY	WALK	696.467011431304	KAGERA	KAGERA	KAG	SOMETIMES	NEVER	8		22.0	672.41224856515	No	526.103008124183	442.176915000685	538.60321642489	461.719597364084
26	13.0	South Africa	ELECTRIC	NEVER	4	ALL THE TIME	12	RURAL	WALK	848.478480580758	KZ	ILEMBE	KZN	SOMETIMES	ONE YEAR	8		47.0	884.627411525484	No	640.365374518107	585.299482549246	625.158688152527	595.898128574306
27	4.0	Tanzania	PARAFFIN/OIL	NEVER	1	SOMETIMES	14	RURAL	WALK	803.02131290024	KILIMANJARO	KILIMANJARO	KIL	NEVER	TWO YEARS	8		30.0	615.471820570849	No	638.743955295488	513.288127807832	566.300279449737	517.2661675266
28	4.0	Tanzania	PARAFFIN/OIL	NEVER	1	SOMETIMES	15	RURAL	WALK	803.02131290024	KAGERA	KAGERA	KAG	SOMETIMES	NEVER	8		26.0	777.327610028686	No	695.97051609378	552.669337432043	650.096350363002	548.260055885416
29	5.0	Tanzania	PARAFFIN/OIL	NEVER	1	SOMETIMES	14	LARGE CITY	WALK	696.467011431304	KAGERA	KAGERA	KAG	SOMETIMES	ONE YEAR	8		22.0	672.41224856515	No	638.743955295488	565.496359995357	618.544310880509	543.695722495434
30	4.0	Tanzania	PARAFFIN/OIL	NEVER	1	SOMETIMES	14	LARGE CITY	WALK	696.467011431304	KAGERA	KAGERA	KAG	SOMETIMES	NEVER	8		22.0	672.41224856515	No	638.743955295488	603.9774276853	624.099729783529	551.384357344015
31	4.0	Malawi	PARAFFIN/OIL	NEVER	5	SOMETIMES	13	RURAL	WALK	656.860766323526	Kasungu	Northern	NOR	SOMETIMES	NEVER	8		37.0	624.628070298576	No	388.47312940429	454.216313371515	434.401539798328	444.512243844683
32	4.0	Tanzania	PARAFFIN/OIL	NEVER	1	ALL THE TIME	14	SMALLTOWN	WALK	761.727301665711	TABORA	WESTERN	WES	SOMETIMES	NEVER	7		31.0	734.97995503795	No	526.103008124183	526.56522133828	561.052564992184	529.808078941199
33	13.0	Zanzibar	ELECTRIC	NEVER	0	MOST OF THE TIME	13	LARGE CITY	WALK	670.250377595758	URBAN	URBAN WEST	URW	OFTEN	THREE OR MORE YEARS	7		45.0	741.780846769329	No	514.276185559203	454.216313371515	552.369538547821	502.570985042253
34	8.0	Zanzibar	PARAFFIN/OIL	NEVER	0	ALL THE TIME	15	RURAL	WALK	848.478480580758	WETE	NORTH PEMBA	NOP	OFTEN	NEVER	7		26.0	642.082171342055	No	584.760232942433	407.633968273163	535.244099381795	459.706389861761
35	12.0	Seychelles	ELECTRIC	NEVER	7	MOST OF THE TIME	11	RURAL	BUS/TRUCK/VAN	735.398150088381	West	West	WES	NEVER	TWO YEARS	7		53.0	740.607233516448	No	455.523583139623	407.633968273163	452.336282276827	433.536714609991
36	8.0	South Africa	ELECTRIC	NEVER	4	NEVER	12	RURAL	WALK	696.467011431304	MP	NOT APPLICABLE	MPU	SOMETIMES	TWO YEARS	7		48.0	668.40638930927	One per day	408.883936089015	439.363971456099	415.501664031764	453.855281313575
37	4.0	Tanzania	PARAFFIN/OIL	TWICE	0	NEVER	13	RURAL	WALK	775.229430679726	TANGA	NORTHEAST	NOE	OFTEN	ONE YEAR	7		34.0	649.235491441842	No	498.920391744994	486.058834296235	503.053015487202	492.368368822291
38	3.0	Tanzania	PARAFFIN/OIL	ONCE	0	SOMETIMES	16	SMALLTOWN	WALK	817.536101590307	KAGERA	KAGERA	KAG	SOMETIMES	ONE YEAR	7		26.0	734.97995503795	No	615.185687766858	616.916967990398	624.335881558818	598.268284057864
39	5.0	Tanzania	PARAFFIN/OIL	ONCE	0	ALL THE TIME	14	SMALLTOWN	WALK	761.727301665711	TANGA	NORTHEAST	NOE	SOMETIMES	ONE YEAR	7		25.0	672.41224856515	No	626.726377527847	539.729797126945	602.037542852676	520.899062796535
40	5.0	Seychelles	ELECTRIC	ONCE	7	NEVER	12	SMALLTOWN	WALK	722.458609783283	Island	Island	ISL	NEVER	NEVER	7		58.0	753.864720101386	No	398.773910347983	407.633968273163	415.248417076527	450.635816965894
41	3.0	Tanzania	PARAFFIN/OIL	NEVER	1	NEVER	15	RURAL	WALK	902.486996636819	MWANZA	MWANZA	MWA	SOMETIMES	ONE YEAR	7		27.0	762.639459423791	No	507.981263871391	643.133601825944	509.750639607226	596.909454488433
42	4.0	Tanzania	PARAFFIN/OIL	NEVER	0	SOMETIMES	17	SMALLTOWN	WALK	817.536101590307	KAGERA	KAGERA	KAG	SOMETIMES	ONE YEAR	7		26.0	734.97995503795	No	695.97051609378	578.323382558671	674.738320423792	578.093772902923
43	4.0	Tanzania	PARAFFIN/OIL	NEVER	1	MOST OF THE TIME	15	SMALLTOWN	WALK	832.61347898929	TABORA	WESTERN	WES	SOMETIMES	NEVER	6		26.0	684.334448731461	No	583.329568922475	539.729797126945	572.785272814109	545.058678999496
44	3.0	Tanzania	PARAFFIN/OIL	NEVER	1	ALL THE TIME	13	SMALLTOWN	WALK	832.61347898929	TABORA	WESTERN	WES	SOMETIMES	NEVER	6		26.0	684.334448731461	No	573.314920782774	578.323382558671	585.09324133404	574.842568033913
45	7.0	Zanzibar	ELECTRIC	NEVER	0	ALL THE TIME	16	LARGE CITY	WALK	670.250377595758	URBAN	URBAN WEST	URW	OFTEN	THREE OR MORE YEARS	6		45.0	741.780846769329	No	514.276185559203	468.618584319798	538.484236858501	483.024813167606
46	3.0	Lesotho	CANDLE	NEVER	4	SOMETIMES	14	RURAL	WALK	817.536101590307	QACHA'S NEK	QACHA'S NEK	QNK	OFTEN	TWO YEARS	6		25.0	727.826634938163	One per day	455.523583139623	390.531271522077	455.815962557717	462.712151646767
47	4.0	Malawi	PARAFFIN/OIL	NEVER	5	SOMETIMES	14	LARGE CITY	WALK	683.414953384423	Thyolo	Southern western	SWE	SOMETIMES	NEVER	6		30.0	657.247209953603	One per day	418.612451424724	454.216313371515	452.532474755074	461.165386481325
48	11.0	Seychelles	ELECTRIC	NEVER	7	SOMETIMES	11	RURAL	BUS/TRUCK/VAN	735.398150088381	West	West	WES	NEVER	TWO YEARS	6		53.0	740.607233516448	No	428.150211557773	454.216313371515	429.582914446744	461.791527172687
49	11.0	Seychelles	ELECTRIC	NEVER	7	MOST OF THE TIME	11	RURAL	BUS/TRUCK/VAN	735.398150088381	West	West	WES	NEVER	TWO YEARS	6		53.0	740.607233516448	No	418.612451424724	468.618584319798	431.193802392549	457.694089422548
50	9.0	Seychelles	ELECTRIC	NEVER	7	NEVER	12	RURAL	BUS/TRUCK/VAN	735.398150088381	West	West	WES	NEVER	THREE OR MORE YEARS	6		53.0	740.607233516448	No	329.243638978058	522.289547150508	373.216544834316	487.407009884974
51	10.0	Namibia	ELECTRIC	ONCE	6	SOMETIMES	13	LARGE CITY	WALK	748.562725877046	Oranjemund	Karas	KAR	SOMETIMES	A FEW MONTHS	6		36.0	864.598115246081	One per day	746.711400001599	509.350006845411	638.778637949906	491.081137370958
52	12.0	Mauritius	ELECTRIC	NEVER	3	SOMETIMES	11	SMALLTOWN	CAR	803.746765127295	Port Louis & North	1PL&N(G)	1PL	SOMETIMES	TWO YEARS	6		53.0	741.780846769329	One per day	398.773910347983	509.350006845411	474.139656565384	560.05190776481
53	3.0	Tanzania	PARAFFIN/OIL	ONCE	0	NEVER	14	RURAL	WALK	761.727301665711	DODOMA	CENTRAL	CEN	SOMETIMES	NEVER	6		25.0	696.542781701763	No	498.920391744994	426.536948892784	509.537255487073	445.908039628439
54	10.0	Tanzania	ELECTRIC	ONCE	1	SOMETIMES	14	LARGE CITY	WALK	696.467011431304	KAGERA	KAGERA	KAG	SOMETIMES	TWO YEARS	6		22.0	672.41224856515	No	553.953267712685	539.729797126945	550.850740764987	530.493303691839
55	4.0	Tanzania	PARAFFIN/OIL	ONCE	1	SOMETIMES	15	LARGE CITY	WALK	696.467011431304	KAGERA	KAGERA	KAG	SOMETIMES	NEVER	6		22.0	672.41224856515	No	507.981263871391	426.536948892784	539.641242652704	453.575406939156
56	1.0	Mozambique	FIRE	ONCE	5	SOMETIMES	14	LARGE CITY	WALK	635.707430868236	Muembe	Niassa	NIA	SOMETIMES	NEVER	6		38.0	709.132625077388	No	433.300602029619	494.385147188211	454.47490577939	468.692483408152
57	6.0	Tanzania	GAS	NEVER	0	ALL THE TIME	16	RURAL	WALK	902.486996636819	MWANZA	MWANZA	MWA	SOMETIMES	NEVER	6		30.0	777.327610028686	No	544.606262782297	471.881598831518	572.613756017669	507.753417603802
58	4.0	Tanzania	PARAFFIN/OIL	NEVER	0	MOST OF THE TIME	15	RURAL	WALK	902.486996636819	MWANZA	MWANZA	MWA	SOMETIMES	NEVER	6		30.0	777.327610028686	No	544.606262782297	578.323382558671	586.394160098043	573.685958288636
59	3.0	Tanzania	PARAFFIN/OIL	NEVER	0	ALL THE TIME	18	RURAL	WALK	865.243624106494	ARUSHA	NORTHERN	NOR	OFTEN	NEVER	6		23.0	777.327610028686	No	563.586405447064	552.669337432043	551.410268335799	537.630264964529
60	3.0	Tanzania	FIRE	NEVER	0	SOMETIMES	13	RURAL	WALK	865.243624106494	ARUSHA	NORTHERN	NOR	OFTEN	NEVER	6		23.0	777.327610028686	No	593.534972264837	578.323382558671	561.121430775565	557.37496110852
61	2.0	Tanzania	PARAFFIN/OIL	NEVER	0	ALL THE TIME	16	SMALLTOWN	WALK	817.536101590307	KAGERA	KAGERA	KAG	SOMETIMES	NEVER	6		26.0	734.97995503795	No	615.185687766858	499.785998793817	632.853171973113	556.01080827229
62	1.0	Tanzania	PARAFFIN/OIL	NEVER	0	ALL THE TIME	15	SMALLTOWN	WALK	817.536101590307	KAGERA	KAGERA	KAG	SOMETIMES	NEVER	6		26.0	734.97995503795	No	651.619931475104	747.550066200995	641.720564368413	673.837184460437
63	11.0	Seychelles	ELECTRIC	NEVER	7	NEVER	12	ISOLATED	BUS/TRUCK/VAN	788.956595177308	West	West	WES	NEVER	TWO YEARS	6		32.0	846.094860587967	No	418.612451424724	423.836523089981	446.123963723016	455.024623701774
64	9.0	Seychelles	ELECTRIC	NEVER	7	NEVER	12	SMALLTOWN	BUS/TRUCK/VAN	722.458609783283	Island	Island	ISL	NEVER	TWO YEARS	6		58.0	753.864720101386	No	342.405747961665	423.836523089981	376.700793796877	471.721380963052
65	3.0	Tanzania	PARAFFIN/OIL	NEVER	1	ALL THE TIME	14	SMALLTOWN	WALK	832.61347898929	TABORA	WESTERN	WES	SOMETIMES	NEVER	5		26.0	684.334448731461	No	573.314920782774	471.881598831518	589.06267476622	570.335156136373
66	6.0	Tanzania	NO LIGHTING	NEVER	0	ALL THE TIME	12	RURAL	WALK	923.752849833893	DODOMA	CENTRAL	CEN	SOMETIMES	ONE YEAR	5		25.0	777.327610028686	No	638.743955295488	591.150405121986	620.783619667941	575.822432920001
67	4.0	Tanzania	PARAFFIN/OIL	NEVER	0	ALL THE TIME	15	RURAL	WALK	923.752849833893	DODOMA	CENTRAL	CEN	SOMETIMES	ONE YEAR	5		25.0	777.327610028686	No	638.743955295488	603.9774276853	641.583720599751	617.267195408715
68	6.0	Malawi	CANDLE	THREE PLUS	5	NEVER	17	LARGE CITY	WALK	848.478480580758	Salima	Central eastern	CEA	OFTEN	NEVER	5		40.0	679.756323867598	No	418.612451424724	535.116569713823	428.952039004983	478.038710071488
69	3.0	Zanzibar	PARAFFIN/OIL	ONCE	0	ALL THE TIME	17	RURAL	WALK	848.478480580758	WETE	NORTH PEMBA	NOP	OFTEN	NEVER	5		26.0	642.082171342055	No	563.491027845734	468.618584319798	506.750292498683	463.956028360453
70	2.0	Malawi	PARAFFIN/OIL	ONCE	5	NEVER	13	LARGE CITY	WALK	848.478480580758	Salima	Central eastern	CEA	OFTEN	NEVER	5		40.0	679.756323867598	No	524.863099306887	482.570784300947	460.93371866939	465.757070867943
71	6.0	Zanzibar	ELECTRIC	NEVER	0	ALL THE TIME	15	LARGE CITY	WALK	683.414953384423	URBAN	URBAN WEST	URW	OFTEN	NEVER	5		49.0	630.732236783727	No	543.366353965001	482.570784300947	546.550934454945	485.895367994996
72	8.0	Malawi	ELECTRIC	NEVER	5	NEVER	15	LARGE CITY	WALK	683.414953384423	Thyolo	Southern western	SWE	SOMETIMES	NEVER	5		30.0	657.247209953603	One per day	437.40183888683	439.363971456099	437.159864887945	441.971983875804
73	12.0	Seychelles	ELECTRIC	NEVER	7	SOMETIMES	11	RURAL	BUS/TRUCK/VAN	735.398150088381	West	West	WES	NEVER	NEVER	5		53.0	740.607233516448	No	398.773910347983	496.072913314962	413.465552454355	481.859288604131
74	8.0	Seychelles	NO LIGHTING	NEVER	7	SOMETIMES	11	RURAL	WALK	735.398150088381	West	West	WES	NEVER	TWO YEARS	5		53.0	740.607233516448	No	418.612451424724	423.836523089981	481.498683220366	463.586718495163
75	3.0	Zanzibar	PARAFFIN/OIL	NEVER	0	ALL THE TIME	13	ISOLATED	WALK	656.860766323526	WEST	URBAN WEST	URW	NEVER	ONE YEAR	5		34.0	689.580216804638	No	563.491027845734	522.289547150508	539.260312541244	486.591604716068
76	10.0	Mauritius	ELECTRIC	NEVER	3	SOMETIMES	11	LARGE CITY	BUS/TRUCK/VAN	803.746765127295	Vacoas & West	4VA&W(G)	4VA	NEVER	TWO YEARS	5		58.0	741.780846769329	One per day	693.109188053866	718.745524304429	609.604914848224	687.42545581081
77	12.0	Seychelles	ELECTRIC	THREE PLUS	7	NEVER	11	SMALLTOWN	WALK	722.458609783283	Island	Island	ISL	NEVER	TWO YEARS	5		58.0	753.864720101386	No	300.24884817359	439.363971456099	367.386878801864	477.257484496101
78	4.0	Tanzania	PARAFFIN/OIL	ONCE	0	SOMETIMES	17	RURAL	WALK	923.752849833893	ARUSHA	NORTHERN	NOR	SOMETIMES	ONE YEAR	5		22.0	684.334448731461	No	583.329568922475	539.729797126945	544.770164978098	532.379697908321
79	4.0	Tanzania	PARAFFIN/OIL	ONCE	0	SOMETIMES	16	RURAL	WALK	923.752849833893	ARUSHA	NORTHERN	NOR	SOMETIMES	A FEW MONTHS	5		22.0	684.334448731461	No	443.792138175973	499.785998793817	490.89238045849	516.360223249995
80	5.0	Tanzania	PARAFFIN/OIL	ONCE	0	ALL THE TIME	15	SMALLTOWN	WALK	817.536101590307	KAGERA	KAGERA	KAG	SOMETIMES	NEVER	5		26.0	734.97995503795	No	517.042135997787	442.176915000685	560.601147664908	518.745967932367
81	5.0	Tanzania	PARAFFIN/OIL	ONCE	0	NEVER	14	SMALLTOWN	WALK	817.536101590307	KAGERA	KAGERA	KAG	SOMETIMES	NEVER	5		26.0	734.97995503795	No	626.726377527847	656.635730839959	594.58460276748	602.181075124769
82	3.0	Tanzania	PARAFFIN/OIL	ONCE	0	SOMETIMES	17	SMALLTOWN	WALK	817.536101590307	KAGERA	KAGERA	KAG	SOMETIMES	NEVER	5		26.0	734.97995503795	No	604.217263613852	499.785998793817	598.607840922833	543.549948131442
83	4.0	Tanzania	PARAFFIN/OIL	ONCE	0	ALL THE TIME	15	RURAL	WALK	775.229430679726	TANGA	NORTHEAST	NOE	OFTEN	ONE YEAR	5		34.0	649.235491441842	No	489.954897219928	499.785998793817	498.220243402065	503.758432336748
84	2.0	Tanzania	PARAFFIN/OIL	ONCE	1	NEVER	15	LARGE CITY	WALK	696.467011431304	KAGERA	KAGERA	KAG	SOMETIMES	ONE YEAR	5		22.0	672.41224856515	No	553.953267712685	499.785998793817	540.476928342978	481.684597690392
85	11.0	Tanzania	ELECTRIC	NEVER	0	ALL THE TIME	14	LARGE CITY	WALK	848.478480580758	DAR ES SALAAM	EASTERN	EAS	SOMETIMES	THREE OR MORE YEARS	5		32.0	696.542781701763	No	517.042135997787	499.785998793817	562.488723611556	546.5054935439
86	5.0	Tanzania	PARAFFIN/OIL	NEVER	0	SOMETIMES	14	RURAL	WALK	817.536101590307	ARUSHA	NORTHERN	NOR	SOMETIMES	TWO YEARS	5		27.0	734.97995503795	No	583.329568922475	486.058834296235	572.708121051367	536.603878430712
87	4.0	Tanzania	PARAFFIN/OIL	NEVER	0	SOMETIMES	13	SMALLTOWN	WALK	817.536101590307	KAGERA	KAGERA	KAG	SOMETIMES	TWO YEARS	5		26.0	734.97995503795	No	695.97051609378	565.496359995357	672.622363345879	569.890117018275
88	3.0	Tanzania	PARAFFIN/OIL	NEVER	1	SOMETIMES	14	RURAL	WALK	803.02131290024	KILIMANJARO	KILIMANJARO	KIL	NEVER	ONE YEAR	5		30.0	615.471820570849	No	404.01967842116	457.254292399669	478.32655471438	502.272324763313
89	9.0	Seychelles	ELECTRIC	NEVER	7	NEVER	11	ISOLATED	WALK	788.956595177308	West	West	WES	NEVER	TWO YEARS	5		32.0	846.094860587967	No	388.47312940429	439.363971456099	435.992868802221	458.599052105824
90	7.0	Seychelles	CANDLE	NEVER	7	SOMETIMES	12	ISOLATED	WALK	788.956595177308	West	West	WES	NEVER	TWO YEARS	5		32.0	846.094860587967	No	428.150211557773	509.350006845411	484.500150363536	488.615135426221
91	5.0	Tanzania	PARAFFIN/OIL	NEVER	0	ALL THE TIME	14	RURAL	WALK	775.229430679726	TANGA	NORTHEAST	NOE	OFTEN	A FEW MONTHS	5		34.0	649.235491441842	No	498.920391744994	457.254292399669	545.398668691406	509.590156629448
92	2.0	Tanzania	PARAFFIN/OIL	NEVER	0	SOMETIMES	15	RURAL	WALK	775.229430679726	MWANZA	MWANZA	MWA	SOMETIMES	NEVER	5		24.0	709.037247476057	No	424.430485105884	486.058834296235	497.007770852823	500.015313761011
93	4.0	Tanzania	PARAFFIN/OIL	ONCE	0	SOMETIMES	17	RURAL	WALK	883.133945050064	DODOMA	CENTRAL	CEN	SOMETIMES	A FEW MONTHS	4		25.0	721.817846054342	No	626.726377527847	656.635730839959	600.651810303087	594.590656903812
94	5.0	Tanzania	PARAFFIN/OIL	NEVER	0	ALL THE TIME	13	RURAL	WALK	883.133945050064	DODOMA	CENTRAL	CEN	SOMETIMES	NEVER	4		25.0	721.817846054342	No	626.726377527847	513.288127807832	611.442902285364	562.691315575152
95	3.0	Tanzania	PARAFFIN/OIL	NEVER	1	ALL THE TIME	16	SMALLTOWN	WALK	832.61347898929	TABORA	WESTERN	WES	SOMETIMES	NEVER	4		26.0	684.334448731461	No	615.185687766858	699.392472717674	587.110168546744	595.906228153004
96	8.0	Tanzania	PARAFFIN/OIL	NEVER	0	ALL THE TIME	13	RURAL	WALK	923.752849833893	DODOMA	CENTRAL	CEN	SOMETIMES	ONE YEAR	4		25.0	777.327610028686	No	626.726377527847	656.635730839959	627.760276203954	629.930065744592
97	5.0	Tanzania	PARAFFIN/OIL	NEVER	0	ALL THE TIME	14	RURAL	WALK	923.752849833893	DODOMA	CENTRAL	CEN	SOMETIMES	TWO YEARS	4		25.0	777.327610028686	No	665.258928465364	785.13099195667	647.187686040255	690.118895509233
98	5.0	Tanzania	PARAFFIN/OIL	NEVER	0	ALL THE TIME	13	RURAL	WALK	923.752849833893	DODOMA	CENTRAL	CEN	SOMETIMES	ONE YEAR	4		25.0	777.327610028686	No	679.947079070258	629.969026037279	645.146245254243	608.642593295032
99	10.0	Zanzibar	ELECTRIC	ONCE	0	ALL THE TIME	14	LARGE CITY	WALK	600.039306722879	WEST	URBAN WEST	URW	SOMETIMES	NEVER	4		48.0	552.808736496719	No	632.353656006346	496.072913314962	584.672657893521	491.076047787718
100	11.0	Malawi	ELECTRIC	NEVER	5	NEVER	12	LARGE CITY	WALK	848.478480580758	Salima	Central eastern	CEA	OFTEN	THREE OR MORE YEARS	4		40.0	679.756323867598	No	490.431785226581	454.216313371515	501.500561808767	480.221558387104

Rows: 1-100 | Columns: 24

Let's visualize our model. We begin by creating a bubble plot using the two scores.

In [19]:

africa.bubble(columns = ["zralocp", "zmalocp"],
              size_bubble_col = "zpses",
              catcol = "PENGLISH",
              max_nb_points = 2000)

Out[19]:

<AxesSubplot:xlabel='"zralocp"', ylabel='"zmalocp"'>

Notable influences are home language and the socioeconomic status. It seems like students that both speak Engish at home often (but not all the time) and have a comfortable standard of living tend to perform the best.

Now, let's see how a student's nationality might affect their performance.

In [20]:

africa["country_long"].hist(method = "90%", 
                            of = "pred_zmalocp",
                            max_cardinality = 50)
africa["country_long"].hist(method = "10%", 
                            of = "pred_zmalocp",
                            max_cardinality = 50)

Out[20]:

<AxesSubplot:xlabel='"country_long"', ylabel='10%'>

The students' nationalities seem to have big impact. For example, Swaziland, Kenya, and Tanzanie are probably overrating the bad students (90% of the scores are greater than the average (500)) whereas some countries like Zambia, South Africa, and Malawi are underrating their students (90% of the scores are under 480). This could be related to the global education in the country: some education systems could be harder than the others. Let's break this down by region.

In [21]:

africa["REGION"].hist(method = "50%", 
                      of = "pred_zmalocp",
                      max_cardinality = 50)
africa["province"].hist(method = "50%", 
                        of = "pred_zmalocp",
                        max_cardinality = 50)

Out[21]:

<AxesSubplot:xlabel='"province"', ylabel='50%'>

The same applies to the regions. Let's look at student age.

In [22]:

africa["PAGE"].hist(method = "50%", 
                    of = "pred_zmalocp",
                    h = 2)

Out[22]:

<AxesSubplot:xlabel='"PAGE"', ylabel='50%'>

Young students globally perform better than older ones. An explanation for this could be a matter of focus: the older students get, the more responsibilites they might have, which would understandably impact their academic performance.

Let's look at the the variables 'PLIGHT' (a student's main lighting source) and 'PREPEAT' (repeated years).

In [23]:

africa.hist(columns = ["PREPEAT", "PLIGHT"],
            method = "avg", 
            of = "pred_zmalocp")

Out[23]:

<AxesSubplot:xlabel='"PREPEAT"', ylabel='avg("pred_zmalocp")'>

We can see that students who never repeated a year and have light at home tend to do better in school than those who don't.

Another factor in a student's performance might be their method of transportation, so we'll look at the "ptravel2" variable.

In [24]:

africa["ptravel2"].hist(method = "50%", 
                        of = "pred_zmalocp")

Out[24]:

<AxesSubplot:xlabel='"PTRAVEL2"', ylabel='50%'>

We can clearly see that the more inconvenient it is to get to school, the worse students tend to perform.

An obvious predictor might be the quality of each teacher, so let's take a look at teachers' standardized reading scores (zraloct).

In [25]:

africa["zraloct"].hist(method = "50%",
                       of = "pred_zmalocp",
                       h = 100)

Out[25]:

<AxesSubplot:xlabel='"zraloct"', ylabel='50%'>

Predictably, better teachers generally lead to better results. Let's look at the influence of the 'district'.

In [26]:

africa["district"].hist(method = "50%",
                        of = "pred_zmalocp",
                        h = 100)

Out[26]:

<AxesSubplot:xlabel='"district"', ylabel='50%'>

Here, we can see that Chicualacuala has a very high median score, so we can conclude that a students' district might impact their performance in school.

After assessing several predictors of student-performance, we can hypothesize some solutions. For example, we might suggest in investing in extracurricular activities, ensuring that students have adequate light sources at home, or improving public transportation.

Machine Learning: Finding the Best Students¶

To find the best students we can use each school's ID (the SCHOOL variable) and compute the average score. We can then order these by descending average score and note the top five students at each school.

In [27]:

africa = vp.read_csv("data/africa_education.csv")
# Computing the averaged score
africa["score"] = (africa["zralocp"] + africa["zmalocp"]) / 2 
# Computing the averaged student score
africa.analytic(func = "row_number",
                by = ["schoolname"],
                order_by = {"score": "desc"},
                name = "student_class_position")
# Finding the 3 best students by class
africa.case_when("best",
                 africa["student_class_position"] <= 5, 1,
                 0)
# Selecting the main variables
africa = africa[["PENGLISH", 
                 "PAGE", 
                 "zmaloct", 
                 "zpses", 
                 "PREPEAT",
                 "PTRAVEL2", 
                 "PLIGHT",
                 "SLOCAT",
                 "best",
                 "zpmealsc",
                 "PFATHER",
                 "SPUPPR04",
                 "PNURSERY"]]
# Getting the categories dummies for the Logistic Regression
africa.one_hot_encode(columns = ["PLIGHT", 
                                 "PTRAVEL2",
                                 "PREPEAT",
                                 "PENGLISH",
                                 "SLOCAT",
                                 "PFATHER",
                                 "SPUPPR04",
                                 "PNURSERY",
                                 "zpmealsc"],
                      max_cardinality = 1000)
africa.dropna()

7834 elements were filtered.

Out[27]:

	Abc PENGLISH Varchar(32)	123 PAGE Integer	123 zmaloct Float	123 zpses Numeric(7,3)	Abc PREPEAT Varchar(20)	Abc PTRAVEL2 Varchar(26)	Abc PLIGHT Varchar(24)	Abc SLOCAT Varchar(20)	123 best Integer	Abc zpmealsc Varchar(38)	Abc Varchar(68)	Abc SPUPPR04 Varchar(20)	Abc PNURSERY Varchar(38)	123 PLIGHT_CANDLE Bool	123 PLIGHT_ELECTRIC Bool	123 PLIGHT_FIRE Bool	123 PLIGHT_GAS Bool	123 PLIGHT_NO_LIGHTING Bool	123 PTRAVEL2_BICYCLE Bool	123 PTRAVEL2_BUS_TRUCK_VAN Bool	123 PTRAVEL2_CAR Bool	123 PTRAVEL2_OTHER Bool	123 PTRAVEL2_TRAIN Bool	123 PREPEAT_NEVER Bool	123 PREPEAT_ONCE Bool	...	123 PENGLISH_ALL_THE_TIME Bool	123 PENGLISH_MOST_OF_THE_TIME Bool	123 PENGLISH_NEVER Bool	123 SLOCAT_ISOLATED Bool	123 SLOCAT_LARGE_CITY Bool	123 SLOCAT_RURAL Bool	123 PFATHER_Completed_All_Primary Bool	123 PFATHER_Completed_All_Secondary Bool	123 PFATHER_Completed_Some_Primary Bool	123 PFATHER_Completed_Some_Secondary Bool	123 Bool	123 Bool	123 Bool	123 PFATHER_I_Do_Not_Have_a_Father Bool	123 PFATHER_I_Do_Not_Know Bool	123 Bool	123 Bool	123 SPUPPR04_NEVER Bool	123 SPUPPR04_OFTEN Bool	123 PNURSERY_A_FEW_MONTHS Bool	123 PNURSERY_NEVER Bool	123 PNURSERY_ONE_YEAR Bool	123 PNURSERY_THREE_OR_MORE_YEARS Bool	123 zpmealsc_No Bool	123 zpmealsc_One_per_day Bool
1	MOST OF THE TIME	12	1008.36619165505	12.0	NEVER	WALK	ELECTRIC	SMALLTOWN	1	One per day		OFTEN	TWO YEARS	0	1	0	0	0	0	0	0	0	0	1	0	...	0	1	0	0	0	0	0	0	0	1				0	0			0	1	0	0	0	0	0	1
2	SOMETIMES	12	1008.36619165505	14.0	NEVER	CAR	ELECTRIC	SMALLTOWN	1	One per day		OFTEN	THREE OR MORE YEARS	0	1	0	0	0	0	0	1	0	0	1	0	...	0	0	0	0	0	0	0	0	0	0				0	0			0	1	0	0	0	1	0	1
3	NEVER	12	1008.36619165505	9.0	NEVER	WALK	ELECTRIC	SMALLTOWN	1	One per day		OFTEN	A FEW MONTHS	0	1	0	0	0	0	0	0	0	0	1	0	...	0	0	1	0	0	0	0	0	0	0				0	1			0	1	1	0	0	0	0	1
4	SOMETIMES	11	1008.36619165505	11.0	NEVER	WALK	ELECTRIC	SMALLTOWN	1	One per day		OFTEN	THREE OR MORE YEARS	0	1	0	0	0	0	0	0	0	0	1	0	...	0	0	0	0	0	0	0	0	0	0				0	0			0	1	0	0	0	1	0	1
5	NEVER	12	1008.36619165505	10.0	NEVER	WALK	ELECTRIC	SMALLTOWN	1	One per day		OFTEN	THREE OR MORE YEARS	0	1	0	0	0	0	0	0	0	0	1	0	...	0	0	1	0	0	0	0	0	0	1				0	0			0	1	0	0	0	1	0	1
6	SOMETIMES	13	1008.36619165505	7.0	NEVER	WALK	ELECTRIC	SMALLTOWN	0	One per day		OFTEN	THREE OR MORE YEARS	0	1	0	0	0	0	0	0	0	0	1	0	...	0	0	0	0	0	0	0	0	0	0				0	1			0	1	0	0	0	1	0	1
7	SOMETIMES	12	1008.36619165505	14.0	NEVER	CAR	ELECTRIC	SMALLTOWN	0	One per day		OFTEN	THREE OR MORE YEARS	0	1	0	0	0	0	0	1	0	0	1	0	...	0	0	0	0	0	0	0	0	0	0				0	0			0	1	0	0	0	1	0	1
8	SOMETIMES	12	1008.36619165505	13.0	NEVER	WALK	ELECTRIC	SMALLTOWN	0	One per day		OFTEN	THREE OR MORE YEARS	0	1	0	0	0	0	0	0	0	0	1	0	...	0	0	0	0	0	0	0	0	0	0				0	1			0	1	0	0	0	1	0	1
9	NEVER	12	1008.36619165505	8.0	NEVER	WALK	ELECTRIC	SMALLTOWN	0	One per day		OFTEN	TWO YEARS	0	1	0	0	0	0	0	0	0	0	1	0	...	0	0	1	0	0	0	0	0	1	0				0	0			0	1	0	0	0	0	0	1
10	SOMETIMES	13	1008.36619165505	9.0	ONCE	BUS/TRUCK/VAN	ELECTRIC	SMALLTOWN	0	One per day		OFTEN	ONE YEAR	0	1	0	0	0	0	1	0	0	0	0	1	...	0	0	0	0	0	0	0	1	0	0				0	0			0	1	0	0	1	0	0	1
11	NEVER	12	1008.36619165505	9.0	NEVER	WALK	ELECTRIC	SMALLTOWN	0	One per day		OFTEN	NEVER	0	1	0	0	0	0	0	0	0	0	1	0	...	0	0	1	0	0	0	0	0	0	0				0	0			0	1	0	1	0	0	0	1
12	NEVER	12	1008.36619165505	7.0	ONCE	WALK	ELECTRIC	SMALLTOWN	0	One per day		OFTEN	NEVER	0	1	0	0	0	0	0	0	0	0	0	1	...	0	0	1	0	0	0	0	0	1	0				0	0			0	1	0	1	0	0	0	1
13	SOMETIMES	13	1008.36619165505	11.0	ONCE	WALK	ELECTRIC	SMALLTOWN	0	One per day		OFTEN	TWO YEARS	0	1	0	0	0	0	0	0	0	0	0	1	...	0	0	0	0	0	0	0	0	0	0				0	0			0	1	0	0	0	0	0	1
14	SOMETIMES	12	1008.36619165505	10.0	NEVER	WALK	ELECTRIC	SMALLTOWN	0	One per day		OFTEN	A FEW MONTHS	0	1	0	0	0	0	0	0	0	0	1	0	...	0	0	0	0	0	0	0	0	0	1				0	0			0	1	1	0	0	0	0	1
15	NEVER	12	1008.36619165505	11.0	NEVER	BUS/TRUCK/VAN	ELECTRIC	SMALLTOWN	0	One per day		OFTEN	THREE OR MORE YEARS	0	1	0	0	0	0	1	0	0	0	1	0	...	0	0	1	0	0	0	0	0	0	0				0	0			0	1	0	0	0	1	0	1
16	SOMETIMES	13	1008.36619165505	8.0	ONCE	WALK	ELECTRIC	SMALLTOWN	0	One per day		OFTEN	THREE OR MORE YEARS	0	1	0	0	0	0	0	0	0	0	0	1	...	0	0	0	0	0	0	0	0	0	0				0	0			0	1	0	0	0	1	0	1
17	SOMETIMES	12	1008.36619165505	10.0	NEVER	WALK	ELECTRIC	SMALLTOWN	0	One per day		OFTEN	THREE OR MORE YEARS	0	1	0	0	0	0	0	0	0	0	1	0	...	0	0	0	0	0	0	0	0	0	1				0	0			0	1	0	0	0	1	0	1
18	NEVER	12	1008.36619165505	9.0	NEVER	CAR	ELECTRIC	SMALLTOWN	0	One per day		OFTEN	NEVER	0	1	0	0	0	0	0	1	0	0	1	0	...	0	0	1	0	0	0	0	0	0	0				0	0			0	1	0	1	0	0	0	1
19	NEVER	14	1008.36619165505	9.0	ONCE	WALK	ELECTRIC	SMALLTOWN	0	One per day		OFTEN	TWO YEARS	0	1	0	0	0	0	0	0	0	0	0	1	...	0	0	1	0	0	0	0	0	0	0				0	0			0	1	0	0	0	0	0	1
20	NEVER	14	1008.36619165505	9.0	TWICE	BUS/TRUCK/VAN	ELECTRIC	SMALLTOWN	0	One per day		OFTEN	THREE OR MORE YEARS	0	1	0	0	0	0	1	0	0	0	0	0	...	0	0	1	0	0	0	0	0	1	0				0	0			0	1	0	0	0	1	0	1
21	NEVER	13	1008.36619165505	9.0	ONCE	WALK	ELECTRIC	SMALLTOWN	0	One per day		OFTEN	TWO YEARS	0	1	0	0	0	0	0	0	0	0	0	1	...	0	0	1	0	0	0	0	0	1	0				0	0			0	1	0	0	0	0	0	1
22	MOST OF THE TIME	12	902.486996636819	12.0	NEVER	WALK	ELECTRIC	SMALLTOWN	1	No		NEVER	THREE OR MORE YEARS	0	1	0	0	0	0	0	0	0	0	1	0	...	0	1	0	0	0	0	0	0	0	0				0	0			1	0	0	0	0	1	1	0
23	MOST OF THE TIME	11	1008.36619165505	11.0	NEVER	WALK	ELECTRIC	SMALLTOWN	1	No		NEVER	ONE YEAR	0	1	0	0	0	0	0	0	0	0	1	0	...	0	1	0	0	0	0	0	0	0	0				0	0			1	0	0	0	1	0	1	0
24	SOMETIMES	12	975.173457828934	12.0	ONCE	WALK	ELECTRIC	SMALLTOWN	1	No		NEVER	TWO YEARS	0	1	0	0	0	0	0	0	0	0	0	1	...	0	0	0	0	0	0	0	0	0	0				0	0			1	0	0	0	0	0	1	0
25	SOMETIMES	13	1008.36619165505	12.0	TWICE	WALK	ELECTRIC	SMALLTOWN	1	No		NEVER	ONE YEAR	0	1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0				0	0			1	0	0	0	1	0	1	0
26	MOST OF THE TIME	11	1008.36619165505	11.0	NEVER	WALK	ELECTRIC	SMALLTOWN	1	No		NEVER	ONE YEAR	0	1	0	0	0	0	0	0	0	0	1	0	...	0	1	0	0	0	0	0	0	0	0				0	0			1	0	0	0	1	0	1	0
27	SOMETIMES	13	902.486996636819	11.0	ONCE	WALK	ELECTRIC	SMALLTOWN	0	No		NEVER	TWO YEARS	0	1	0	0	0	0	0	0	0	0	0	1	...	0	0	0	0	0	0	0	0	0	0				0	0			1	0	0	0	0	0	1	0
28	SOMETIMES	12	975.173457828934	12.0	ONCE	WALK	ELECTRIC	SMALLTOWN	0	No		NEVER	NEVER	0	1	0	0	0	0	0	0	0	0	0	1	...	0	0	0	0	0	0	0	0	0	0				0	0			1	0	0	1	0	0	1	0
29	MOST OF THE TIME	11	975.173457828934	11.0	ONCE	WALK	ELECTRIC	SMALLTOWN	0	No		NEVER	TWO YEARS	0	1	0	0	0	0	0	0	0	0	0	1	...	0	1	0	0	0	0	0	0	0	0				0	0			1	0	0	0	0	0	1	0
30	SOMETIMES	11	902.486996636819	11.0	ONCE	WALK	ELECTRIC	SMALLTOWN	0	No		NEVER	TWO YEARS	0	1	0	0	0	0	0	0	0	0	0	1	...	0	0	0	0	0	0	0	0	0	0				0	0			1	0	0	0	0	0	1	0
31	SOMETIMES	13	975.173457828934	10.0	ONCE	WALK	ELECTRIC	SMALLTOWN	0	No		NEVER	NEVER	0	1	0	0	0	0	0	0	0	0	0	1	...	0	0	0	0	0	0	0	1	0	0				0	0			1	0	0	1	0	0	1	0
32	SOMETIMES	12	902.486996636819	12.0	NEVER	WALK	ELECTRIC	SMALLTOWN	0	No		NEVER	THREE OR MORE YEARS	0	1	0	0	0	0	0	0	0	0	1	0	...	0	0	0	0	0	0	0	0	0	0				0	0			1	0	0	0	0	1	1	0
33	SOMETIMES	12	975.173457828934	13.0	TWICE	WALK	ELECTRIC	SMALLTOWN	0	No		NEVER	TWO YEARS	0	1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	0	0	0				0	0			1	0	0	0	0	0	1	0
34	SOMETIMES	12	975.173457828934	12.0	ONCE	WALK	ELECTRIC	SMALLTOWN	0	No		NEVER	THREE OR MORE YEARS	0	1	0	0	0	0	0	0	0	0	0	1	...	0	0	0	0	0	0	0	0	0	0				0	0			1	0	0	0	0	1	1	0
35	SOMETIMES	12	902.486996636819	11.0	ONCE	WALK	ELECTRIC	SMALLTOWN	0	No		NEVER	TWO YEARS	0	1	0	0	0	0	0	0	0	0	0	1	...	0	0	0	0	0	0	0	0	0	0				0	0			1	0	0	0	0	0	1	0
36	SOMETIMES	12	1008.36619165505	11.0	NEVER	WALK	ELECTRIC	SMALLTOWN	0	No		NEVER	TWO YEARS	0	1	0	0	0	0	0	0	0	0	1	0	...	0	0	0	0	0	0	0	0	0	0				0	0			1	0	0	0	0	0	1	0
37	SOMETIMES	12	902.486996636819	12.0	ONCE	WALK	ELECTRIC	SMALLTOWN	0	No		NEVER	THREE OR MORE YEARS	0	1	0	0	0	0	0	0	0	0	0	1	...	0	0	0	0	0	0	0	0	0	0				0	0			1	0	0	0	0	1	1	0
38	SOMETIMES	12	1008.36619165505	12.0	NEVER	WALK	ELECTRIC	SMALLTOWN	0	No		NEVER	TWO YEARS	0	1	0	0	0	0	0	0	0	0	1	0	...	0	0	0	0	0	0	0	0	0	0				0	0			1	0	0	0	0	0	1	0
39	SOMETIMES	14	975.173457828934	9.0	TWICE	WALK	ELECTRIC	SMALLTOWN	0	No		NEVER	TWO YEARS	0	1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	0	0	1	0	0				0	0			1	0	0	0	0	0	1	0
40	MOST OF THE TIME	12	902.486996636819	13.0	NEVER	WALK	ELECTRIC	SMALLTOWN	0	No		NEVER	THREE OR MORE YEARS	0	1	0	0	0	0	0	0	0	0	1	0	...	0	1	0	0	0	0	0	0	0	0				0	0			1	0	0	0	0	1	1	0
41	SOMETIMES	12	902.486996636819	10.0	NEVER	WALK	ELECTRIC	SMALLTOWN	0	No		NEVER	ONE YEAR	0	1	0	0	0	0	0	0	0	0	1	0	...	0	0	0	0	0	0	0	0	0	0				0	0			1	0	0	0	1	0	1	0
42	MOST OF THE TIME	11	1008.36619165505	11.0	NEVER	WALK	ELECTRIC	SMALLTOWN	0	No		NEVER	TWO YEARS	0	1	0	0	0	0	0	0	0	0	1	0	...	0	1	0	0	0	0	0	0	0	0				0	0			1	0	0	0	0	0	1	0
43	MOST OF THE TIME	12	1008.36619165505	12.0	NEVER	WALK	ELECTRIC	SMALLTOWN	0	No		NEVER	ONE YEAR	0	1	0	0	0	0	0	0	0	0	1	0	...	0	1	0	0	0	0	0	0	0	0				0	0			1	0	0	0	1	0	1	0
44	MOST OF THE TIME	12	975.173457828934	12.0	NEVER	WALK	ELECTRIC	SMALLTOWN	0	No		NEVER	THREE OR MORE YEARS	0	1	0	0	0	0	0	0	0	0	1	0	...	0	1	0	0	0	0	0	0	0	0				0	0			1	0	0	0	0	1	1	0
45	SOMETIMES	11	1008.36619165505	11.0	NEVER	WALK	ELECTRIC	SMALLTOWN	0	No		NEVER	THREE OR MORE YEARS	0	1	0	0	0	0	0	0	0	0	1	0	...	0	0	0	0	0	0	0	0	0	0				0	0			1	0	0	0	0	1	1	0
46	SOMETIMES	12	1008.36619165505	11.0	NEVER	WALK	ELECTRIC	SMALLTOWN	0	No		NEVER	ONE YEAR	0	1	0	0	0	0	0	0	0	0	1	0	...	0	0	0	0	0	0	0	0	0	0				0	0			1	0	0	0	1	0	1	0
47	SOMETIMES	11	696.467011431304	11.0	NEVER	WALK	ELECTRIC	RURAL	1	One per day		OFTEN	ONE YEAR	0	1	0	0	0	0	0	0	0	0	1	0	...	0	0	0	0	0	1	0	1	0	0				0	0			0	1	0	0	1	0	0	1
48	NEVER	12	696.467011431304	9.0	ONCE	WALK	ELECTRIC	RURAL	1	One per day		OFTEN	NEVER	0	1	0	0	0	0	0	0	0	0	0	1	...	0	0	1	0	0	1	0	0	0	0				0	1			0	1	0	1	0	0	0	1
49	SOMETIMES	11	696.467011431304	5.0	NEVER	WALK	CANDLE	RURAL	1	One per day		OFTEN	NEVER	1	0	0	0	0	0	0	0	0	0	1	0	...	0	0	0	0	0	1	0	1	0	0				0	0			0	1	0	1	0	0	0	1
50	NEVER	13	696.467011431304	6.0	NEVER	WALK	ELECTRIC	RURAL	1	One per day		OFTEN	ONE YEAR	0	1	0	0	0	0	0	0	0	0	1	0	...	0	0	1	0	0	1	0	0	1	0				0	0			0	1	0	0	1	0	0	1
51	SOMETIMES	12	696.467011431304	13.0	NEVER	WALK	ELECTRIC	RURAL	1	One per day		OFTEN	THREE OR MORE YEARS	0	1	0	0	0	0	0	0	0	0	1	0	...	0	0	0	0	0	1	0	1	0	0				0	0			0	1	0	0	0	1	0	1
52	NEVER	14	696.467011431304	7.0	ONCE	WALK	CANDLE	RURAL	0	One per day		OFTEN	NEVER	1	0	0	0	0	0	0	0	0	0	0	1	...	0	0	1	0	0	1	0	1	0	0				0	0			0	1	0	1	0	0	0	1
53	SOMETIMES	14	696.467011431304	11.0	NEVER	WALK	GAS	RURAL	0	One per day		OFTEN	NEVER	0	0	0	1	0	0	0	0	0	0	1	0	...	0	0	0	0	0	1	0	0	0	0				0	0			0	1	0	1	0	0	0	1
54	NEVER	13	696.467011431304	7.0	NEVER	WALK	CANDLE	RURAL	0	One per day		OFTEN	NEVER	1	0	0	0	0	0	0	0	0	0	1	0	...	0	0	1	0	0	1	0	0	0	0				0	0			0	1	0	1	0	0	0	1
55	SOMETIMES	15	696.467011431304	9.0	ONCE	WALK	CANDLE	RURAL	0	One per day		OFTEN	ONE YEAR	1	0	0	0	0	0	0	0	0	0	0	1	...	0	0	0	0	0	1	0	0	0	0				0	0			0	1	0	0	1	0	0	1
56	NEVER	15	696.467011431304	4.0	ONCE	WALK	CANDLE	RURAL	0	One per day		OFTEN	NEVER	1	0	0	0	0	0	0	0	0	0	0	1	...	0	0	1	0	0	1	0	0	0	0				0	1			0	1	0	1	0	0	0	1
57	SOMETIMES	15	696.467011431304	3.0	NEVER	WALK	CANDLE	RURAL	0	One per day		OFTEN	ONE YEAR	1	0	0	0	0	0	0	0	0	0	1	0	...	0	0	0	0	0	1	1	0	0	0				0	0			0	1	0	0	1	0	0	1
58	SOMETIMES	11	696.467011431304	5.0	NEVER	WALK	CANDLE	RURAL	0	One per day		OFTEN	NEVER	1	0	0	0	0	0	0	0	0	0	1	0	...	0	0	0	0	0	1	0	0	0	0				1	0			0	1	0	1	0	0	0	1
59	SOMETIMES	12	696.467011431304	9.0	THREE PLUS	WALK	ELECTRIC	RURAL	0	One per day		OFTEN	THREE OR MORE YEARS	0	1	0	0	0	0	0	0	0	0	0	0	...	0	0	0	0	0	1	0	0	0	0				0	0			0	1	0	0	0	1	0	1
60	SOMETIMES	14	696.467011431304	7.0	ONCE	WALK	ELECTRIC	RURAL	0	One per day		OFTEN	THREE OR MORE YEARS	0	1	0	0	0	0	0	0	0	0	0	1	...	0	0	0	0	0	1	0	0	0	1				0	0			0	1	0	0	0	1	0	1
61	NEVER	14	696.467011431304	2.0	ONCE	WALK	CANDLE	RURAL	0	One per day		OFTEN	ONE YEAR	1	0	0	0	0	0	0	0	0	0	0	1	...	0	0	1	0	0	1	0	0	0	0				0	1			0	1	0	0	1	0	0	1
62	SOMETIMES	13	696.467011431304	8.0	ONCE	WALK	GAS	RURAL	0	One per day		OFTEN	NEVER	0	0	0	1	0	0	0	0	0	0	0	1	...	0	0	0	0	0	1	0	0	0	0				0	0			0	1	0	1	0	0	0	1
63	SOMETIMES	17	696.467011431304	3.0	NEVER	WALK	PARAFFIN/OIL	RURAL	0	One per day		OFTEN	NEVER	0	0	0	0	0	0	0	0	0	0	1	0	...	0	0	0	0	0	1	0	0	1	0				0	0			0	1	0	1	0	0	0	1
64	NEVER	14	696.467011431304	5.0	ONCE	WALK	CANDLE	RURAL	0	One per day		OFTEN	NEVER	1	0	0	0	0	0	0	0	0	0	0	1	...	0	0	1	0	0	1	0	0	0	1				0	0			0	1	0	1	0	0	0	1
65	MOST OF THE TIME	12	696.467011431304	9.0	NEVER	WALK	PARAFFIN/OIL	RURAL	0	One per day		OFTEN	THREE OR MORE YEARS	0	0	0	0	0	0	0	0	0	0	1	0	...	0	1	0	0	0	1	0	0	0	0				0	1			0	1	0	0	0	1	0	1
66	SOMETIMES	12	696.467011431304	6.0	ONCE	WALK	CANDLE	RURAL	0	One per day		OFTEN	A FEW MONTHS	1	0	0	0	0	0	0	0	0	0	0	1	...	0	0	0	0	0	1	0	0	0	1				0	0			0	1	1	0	0	0	0	1
67	NEVER	12	696.467011431304	9.0	ONCE	WALK	ELECTRIC	RURAL	0	One per day		OFTEN	TWO YEARS	0	1	0	0	0	0	0	0	0	0	0	1	...	0	0	1	0	0	1	0	0	0	1				0	0			0	1	0	0	0	0	0	1
68	SOMETIMES	13	696.467011431304	3.0	NEVER	WALK	CANDLE	RURAL	0	One per day		OFTEN	NEVER	1	0	0	0	0	0	0	0	0	0	1	0	...	0	0	0	0	0	1	0	0	1	0				0	0			0	1	0	1	0	0	0	1
69	MOST OF THE TIME	14	696.467011431304	4.0	ONCE	WALK	CANDLE	RURAL	0	One per day		OFTEN	THREE OR MORE YEARS	1	0	0	0	0	0	0	0	0	0	0	1	...	0	1	0	0	0	1	0	0	0	0				0	1			0	1	0	0	0	1	0	1
70	SOMETIMES	11	696.467011431304	3.0	NEVER	WALK	CANDLE	RURAL	0	One per day		OFTEN	NEVER	1	0	0	0	0	0	0	0	0	0	1	0	...	0	0	0	0	0	1	0	0	1	0				0	0			0	1	0	1	0	0	0	1
71	NEVER	15	696.467011431304	6.0	ONCE	WALK	ELECTRIC	RURAL	0	One per day		OFTEN	NEVER	0	1	0	0	0	0	0	0	0	0	0	1	...	0	0	1	0	0	1	0	0	0	0				0	1			0	1	0	1	0	0	0	1
72	MOST OF THE TIME	14	817.536101590307	8.0	NEVER	WALK	PARAFFIN/OIL	RURAL	1	No		SOMETIMES	ONE YEAR	0	0	0	0	0	0	0	0	0	0	1	0	...	0	1	0	0	0	1	0	0	0	0				0	0			0	0	0	0	1	0	1	0
73	ALL THE TIME	13	817.536101590307	9.0	NEVER	WALK	PARAFFIN/OIL	RURAL	1	No		SOMETIMES	A FEW MONTHS	0	0	0	0	0	0	0	0	0	0	1	0	...	1	0	0	0	0	1	0	1	0	0				0	0			0	0	1	0	0	0	1	0
74	ALL THE TIME	13	817.536101590307	4.0	NEVER	WALK	PARAFFIN/OIL	RURAL	1	No		SOMETIMES	ONE YEAR	0	0	0	0	0	0	0	0	0	0	1	0	...	1	0	0	0	0	1	1	0	0	0				0	0			0	0	0	0	1	0	1	0
75	MOST OF THE TIME	15	817.536101590307	3.0	ONCE	WALK	PARAFFIN/OIL	RURAL	1	No		SOMETIMES	A FEW MONTHS	0	0	0	0	0	0	0	0	0	0	0	1	...	0	1	0	0	0	1	1	0	0	0				0	0			0	0	1	0	0	0	1	0
76	MOST OF THE TIME	15	817.536101590307	7.0	ONCE	WALK	PARAFFIN/OIL	RURAL	1	No		SOMETIMES	ONE YEAR	0	0	0	0	0	0	0	0	0	0	0	1	...	0	1	0	0	0	1	0	1	0	0				0	0			0	0	0	0	1	0	1	0
77	SOMETIMES	16	817.536101590307	3.0	NEVER	WALK	PARAFFIN/OIL	RURAL	0	No		SOMETIMES	ONE YEAR	0	0	0	0	0	0	0	0	0	0	1	0	...	0	0	0	0	0	1	1	0	0	0				0	0			0	0	0	0	1	0	1	0
78	ALL THE TIME	15	817.536101590307	4.0	NEVER	WALK	PARAFFIN/OIL	RURAL	0	No		SOMETIMES	NEVER	0	0	0	0	0	0	0	0	0	0	1	0	...	1	0	0	0	0	1	0	0	1	0				0	0			0	0	0	1	0	0	1	0
79	ALL THE TIME	13	817.536101590307	10.0	NEVER	WALK	ELECTRIC	RURAL	0	No		SOMETIMES	A FEW MONTHS	0	1	0	0	0	0	0	0	0	0	1	0	...	1	0	0	0	0	1	0	0	0	0				0	0			0	0	1	0	0	0	1	0
80	ALL THE TIME	13	817.536101590307	5.0	NEVER	WALK	PARAFFIN/OIL	RURAL	0	No		SOMETIMES	ONE YEAR	0	0	0	0	0	0	0	0	0	0	1	0	...	1	0	0	0	0	1	0	1	0	0				0	0			0	0	0	0	1	0	1	0
81	ALL THE TIME	15	817.536101590307	5.0	NEVER	WALK	PARAFFIN/OIL	RURAL	0	No		SOMETIMES	THREE OR MORE YEARS	0	0	0	0	0	0	0	0	0	0	1	0	...	1	0	0	0	0	1	0	0	0	0				0	0			0	0	0	0	0	1	1	0
82	ALL THE TIME	14	817.536101590307	4.0	NEVER	WALK	PARAFFIN/OIL	RURAL	0	No		SOMETIMES	ONE YEAR	0	0	0	0	0	0	0	0	0	0	1	0	...	1	0	0	0	0	1	1	0	0	0				0	0			0	0	0	0	1	0	1	0
83	ALL THE TIME	15	817.536101590307	5.0	ONCE	WALK	PARAFFIN/OIL	RURAL	0	No		SOMETIMES	TWO YEARS	0	0	0	0	0	0	0	0	0	0	0	1	...	1	0	0	0	0	1	0	0	0	0				1	0			0	0	0	0	0	0	1	0
84	MOST OF THE TIME	17	817.536101590307	4.0	NEVER	WALK	PARAFFIN/OIL	RURAL	0	No		SOMETIMES	NEVER	0	0	0	0	0	0	0	0	0	0	1	0	...	0	1	0	0	0	1	0	0	0	0				0	0			0	0	0	1	0	0	1	0
85	ALL THE TIME	16	817.536101590307	1.0	ONCE	WALK	NO LIGHTING	RURAL	0	No		SOMETIMES	NEVER	0	0	0	0	1	0	0	0	0	0	0	1	...	1	0	0	0	0	1	0	0	0	0				0	0			0	0	0	1	0	0	1	0
86	ALL THE TIME	14	817.536101590307	3.0	ONCE	WALK	PARAFFIN/OIL	RURAL	0	No		SOMETIMES	NEVER	0	0	0	0	0	0	0	0	0	0	0	1	...	1	0	0	0	0	1	1	0	0	0				0	0			0	0	0	1	0	0	1	0
87	SOMETIMES	15	817.536101590307	5.0	ONCE	WALK	PARAFFIN/OIL	RURAL	0	No		SOMETIMES	NEVER	0	0	0	0	0	0	0	0	0	0	0	1	...	0	0	0	0	0	1	1	0	0	0				0	0			0	0	0	1	0	0	1	0
88	SOMETIMES	17	817.536101590307	5.0	ONCE	WALK	PARAFFIN/OIL	RURAL	0	No		SOMETIMES	ONE YEAR	0	0	0	0	0	0	0	0	0	0	0	1	...	0	0	0	0	0	1	1	0	0	0				0	0			0	0	0	0	1	0	1	0
89	ALL THE TIME	14	817.536101590307	6.0	ONCE	WALK	PARAFFIN/OIL	RURAL	0	No		SOMETIMES	ONE YEAR	0	0	0	0	0	0	0	0	0	0	0	1	...	1	0	0	0	0	1	1	0	0	0				0	0			0	0	0	0	1	0	1	0
90	MOST OF THE TIME	16	817.536101590307	3.0	NEVER	WALK	PARAFFIN/OIL	RURAL	0	No		SOMETIMES	NEVER	0	0	0	0	0	0	0	0	0	0	1	0	...	0	1	0	0	0	1	0	0	1	0				0	0			0	0	0	1	0	0	1	0
91	NEVER	12	709.406551736402	5.0	NEVER	WALK	CANDLE	ISOLATED	1	One per day		SOMETIMES	NEVER	1	0	0	0	0	0	0	0	0	0	1	0	...	0	0	1	1	0	0	0	0	0	0				0	1			0	0	0	1	0	0	0	1
92	NEVER	13	709.406551736402	8.0	ONCE	WALK	CANDLE	ISOLATED	1	One per day		SOMETIMES	ONE YEAR	1	0	0	0	0	0	0	0	0	0	0	1	...	0	0	1	1	0	0	0	0	1	0				0	0			0	0	0	0	1	0	0	1
93	NEVER	12	709.406551736402	9.0	NEVER	WALK	CANDLE	ISOLATED	1	One per day		SOMETIMES	TWO YEARS	1	0	0	0	0	0	0	0	0	0	1	0	...	0	0	1	1	0	0	0	0	0	0				0	1			0	0	0	0	0	0	0	1
94	NEVER	12	709.406551736402	8.0	NEVER	WALK	CANDLE	ISOLATED	1	One per day		SOMETIMES	ONE YEAR	1	0	0	0	0	0	0	0	0	0	1	0	...	0	0	1	1	0	0	0	1	0	0				0	0			0	0	0	0	1	0	0	1
95	NEVER	14	709.406551736402	7.0	ONCE	BICYCLE	CANDLE	ISOLATED	1	One per day		SOMETIMES	ONE YEAR	1	0	0	0	0	1	0	0	0	0	0	1	...	0	0	1	1	0	0	0	0	0	0				0	0			0	0	0	0	1	0	0	1
96	NEVER	17	709.406551736402	8.0	THREE PLUS	WALK	CANDLE	ISOLATED	0	One per day		SOMETIMES	ONE YEAR	1	0	0	0	0	0	0	0	0	0	0	0	...	0	0	1	1	0	0	0	1	0	0				0	0			0	0	0	0	1	0	0	1
97	NEVER	14	709.406551736402	8.0	NEVER	WALK	CANDLE	ISOLATED	0	One per day		SOMETIMES	TWO YEARS	1	0	0	0	0	0	0	0	0	0	1	0	...	0	0	1	1	0	0	0	1	0	0				0	0			0	0	0	0	0	0	0	1
98	NEVER	12	709.406551736402	8.0	NEVER	WALK	CANDLE	ISOLATED	0	One per day		SOMETIMES	NEVER	1	0	0	0	0	0	0	0	0	0	1	0	...	0	0	1	1	0	0	1	0	0	0				0	0			0	0	0	1	0	0	0	1
99	NEVER	12	709.406551736402	9.0	NEVER	WALK	CANDLE	ISOLATED	0	One per day		SOMETIMES	NEVER	1	0	0	0	0	0	0	0	0	0	1	0	...	0	0	1	1	0	0	0	0	0	1				0	0			0	0	0	1	0	0	0	1
100	ALL THE TIME	14	709.406551736402	4.0	TWICE	WALK	CANDLE	ISOLATED	0	One per day		SOMETIMES	NEVER	1	0	0	0	0	0	0	0	0	0	0	0	...	1	0	0	1	0	0	0	0	0	0				0	0			0	0	0	1	0	0	0	1

Rows: 1-100 of 52075 | Columns: 51

Let's create a logistic regression to understand what circumstances allowed these students to perform as well as they have.

In [28]:

from verticapy.learn.linear_model import LogisticRegression
response = "best"
predictors = africa.get_columns(exclude_columns = ["PLIGHT", 
                                                   "PTRAVEL2",
                                                   "PREPEAT",
                                                   "PENGLISH",
                                                   "SLOCAT",
                                                   "PFATHER",
                                                   "SPUPPR04",
                                                   "PNURSERY",
                                                   "zpmealsc",
                                                   "best"])
model_africa_logit_best = LogisticRegression(name="africa_logit_best", 
                                             solver="BFGS")
model_africa_logit_best.fit(africa,
                            predictors, 
                            response)
x = model_africa_logit_best.features_importance()

We can see that the best students tend to be young, speak English at home, come from a good socioeconomic background, have a father with a degree, and live relatively close to school.

Conclusion¶

We've solved our problem in a Pandas-like way, all without ever loading data into memory!

VerticaPy

Python API for Vertica Data Science at Scale

About the Author

Badr Ouali
Head of Data Science

Badr Ouali works as a Lead Data Scientist for Vertica worldwide. He can embrace data projects end to end through a clear understanding of the “big picture” as well as attention to details, resulting in achieving great business outcomes – a distinctive differentiator in his role. Badr enjoys sharing knowledge and insights related to data analytics with colleagues & peers and has a sweet spot for Python. He loves helping customers finding the best value from their data and empower them to solve their use-cases.