Working with Complex Data Types & VMaps#

Setup#

In order to work with complex data types in VerticaPy, you’ll need to complete the following three setup tasks:

  • Import relevant libraries:

[1]:
import verticapy as vp
  • Connect to Vertica:

[ ]:
vp.new_connection({"host": "10.211.55.14",
                   "port": "5433",
                   "database": "testdb",
                   "password": "XxX",
                   "user": "dbadmin"},
                   name = "Vertica_New_Connection")
  • Check your VerticaPy version to make sure you have access to the right functions:

[2]:
vp.__version__
[2]:
'0.11.0'

You can make it easier to keep track of your work by creating a custom schema: Note: Because some tables are repeated in this demonstration, tables with the same names are dropped.

[3]:
vp.drop("complex_vmap_test", method = "schema")
vp.create_schema("complex_vmap_test")
[3]:
True

We also set the path to our data:

[ ]:
path= "/home/dbadmin/"

You can download the demo datasets by clicking here.

Loading Complex Data#

There are two ways to load a nested data file:

  • Load directly using read_json. In this case, you will need to use an additional parameter to identify all the data types. The function loads the data using flex tables and VMaps (Native Vertica MAPS, which are flexible but not optimally performant).

  • Load using read_file. The function preidcts the complex data structure.

Let’s try both:

[4]:
import verticapy as vp
data = vp.read_json(path + "laliga/2008.json",
                    schema = "public",
                    ingest_local = False,
                    use_complex_dt = True,)
[4]:
123
away_score
Int
🛠
Row(away_team_gender varchar(80),away_team_group varchar(80),away_team_id int,away_team_name varchar(80),country row(id int,name
🛠
Row(competition_id int,competition_name varchar(80),country_name varchar(80))
🛠
Row(id int,name varchar(80))
123
home_score
Int
🛠
Row(country row(id int,name varchar(80)),home_team_gender varchar(80),home_team_group varchar(80),home_team_id int,home_team_nam
📅
kick_off
Time
📅
last_updated
Date
📅
match_date
Date
123
match_id
Int
Abc
match_status
Varchar(80)
123
match_week
Int
🛠
Row(data_version date,shot_fidelity_version int,xy_fidelity_version int)
🛠
Row(season_id int,season_name varchar(80))
10119:00:002019-12-162008-08-3169147available1
20220:00:002019-12-162009-03-0769216available26
30220:00:002019-12-162009-04-1169222available30
40520:00:002019-12-162009-01-1769183available19
50522:00:002019-12-162008-10-2569232available8
60619:00:002019-12-162009-03-2269142available28
71020:00:002019-12-162009-04-0469273available29
82021:00:002019-12-162008-11-1669285available11
92117:00:002019-12-162009-02-0169209available21
104120:00:002019-12-162008-11-0169235available9
116121:00:002019-12-162008-09-2169138available3
121422:00:002019-12-162009-01-2469189available20
131622:00:002019-12-162008-10-0469212available6
142021:03:002019-12-162009-03-1569177available27
152320:00:002019-12-162008-09-2469207available4
163221:00:002019-12-162009-01-1169230available18
170222:00:002019-12-162008-12-1369225available15
180622:00:002019-12-162008-11-0869279available10
191120:00:002019-12-162008-09-1369215available2
201319:00:002019-12-162009-02-0869231available22
212120:00:002019-12-162009-02-2169139available24
222220:00:002019-12-162009-02-1469195available23
232222:00:002019-12-162009-04-2569251available33
243022:00:002019-12-162008-11-2969171available13
253319:03:002019-12-162009-05-1069217available35
263419:00:002019-12-162009-03-0169185available25
270422:00:002019-12-162008-12-0669149available14
281020:00:002019-12-162009-04-1869223available31
292119:00:002019-12-162008-12-2169228available16
302122:00:002019-12-162008-09-2769211available5
316220:00:002019-12-162009-05-0269249available34
Rows: 1-31 | Columns: 14

Similar to the use of read_json above, we can use read_file to ingest the complex data directly:

[6]:
data = vp.read_file(path = path + "laliga/2005.json",
                    ingest_local = False,
                    schema = "complex_vmap_test",)
data
[6]:
123
away_score
Int
🛠
Row(away_team_gender varchar(80),away_team_group varchar(80),away_team_id int,away_team_name varchar(80),country row(id int,name
🛠
Row(competition_id int,competition_name varchar(80),country_name varchar(80))
🛠
Row(id int,name varchar(80))
123
home_score
Int
🛠
Row(country row(id int,name varchar(80)),home_team_gender varchar(80),home_team_group varchar(80),home_team_id int,home_team_nam
📅
kick_off
Time
📅
last_updated
Date
📅
match_date
Date
123
match_id
Int
Abc
match_status
Varchar(80)
123
match_week
Int
🛠
Row(data_version date,shot_fidelity_version int,xy_fidelity_version int)
🛠
Row(season_id int,season_name varchar(80))
10322:00:002019-12-162005-10-2268318available8
21219:00:002019-12-162006-01-1568342available19
31522:00:002019-12-162006-02-1869172available24
43121:00:002019-12-162005-11-0668339available10
50219:00:002019-12-162006-01-2268324available20
60220:30:002019-12-162005-10-2669164available11
71221:00:002020-02-272005-12-1168321available15
82122:00:002019-12-162006-01-0768348available18
92220:00:002019-12-162005-10-0168317available6
103122:00:002019-12-162005-12-1768322available16
110221:00:002019-12-162005-12-2068323available17
122022:00:002019-12-162006-02-2568351available25
133020:00:002019-12-162005-11-1968319available12
143119:00:002019-12-162006-02-0568350available22
151421:00:002019-12-162005-11-2768354available13
162019:00:002019-12-162005-12-0468320available14
173019:00:002019-12-162006-01-2968325available21
Rows: 1-17 | Columns: 14

We can also use the handy ‘genSQL’ parameter to generate (but not execute) the SQL needed to create the final relation: Note: This is a great way to customize the data ingestion or alter the final relation types.

[9]:
sql = vp.read_file(path = path + "laliga/2005.json",
                   schema = "complex_vmap_test",
                   table_name = "laliga_2005",
                   genSQL = True,
                   varchar_varbinary_length = 60,
                   ingest_local = False,
                   dtype = {"away_score": "float"})
for query in sql:
    print(query)
CREATE TABLE "complex_vmap_test"."laliga_2005"("away_score" float, "away_team" Row("away_team_gender" varchar(60), "away_team_group" varchar(60), "away_team_id" int, "away_team_name" varchar(60), "country" Row("id" int, "name" varchar(60))), "competition" Row("competition_id" int, "competition_name" varchar(60), "country_name" varchar(60)), "competition_stage" Row("id" int, "name" varchar(60)), "home_score" int, "home_team" Row("country" Row("id" int, "name" varchar(60)), "home_team_gender" varchar(60), "home_team_group" varchar(60), "home_team_id" int, "home_team_name" varchar(60)), "kick_off" time, "last_updated" date, "match_date" date, "match_id" int, "match_status" varchar(60), "match_week" int, "metadata" Row("data_version" date, "shot_fidelity_version" int, "xy_fidelity_version" int), "season" Row("season_id" int, "season_name" varchar(60)))
copy "complex_vmap_test"."laliga_2005" from '/scratch_b/qa/ericsson/laliga/2005.json' PARSER FJsonParser()

Feature Exploration#

In the generated SQL from the above example, we can see that the away_team column is a ROW type with a complex structure consisting of many sub-columns. We can convert this column into a JSON and view its contents:

[7]:
data["competition_stage"].astype("json")
[7]:
123
away_score
Int
🛠
Row(away_team_gender varchar(80),away_team_group varchar(80),away_team_id int,away_team_name varchar(80),country row(id int,name
🛠
Row(competition_id int,competition_name varchar(80),country_name varchar(80))
Abc
competition_stage
Varchar
123
home_score
Int
🛠
Row(country row(id int,name varchar(80)),home_team_gender varchar(80),home_team_group varchar(80),home_team_id int,home_team_nam
📅
kick_off
Time
📅
last_updated
Date
📅
match_date
Date
123
match_id
Int
Abc
match_status
Varchar(80)
123
match_week
Int
🛠
Row(data_version date,shot_fidelity_version int,xy_fidelity_version int)
🛠
Row(season_id int,season_name varchar(80))
10{"id":1,"name":"Regular Season"}219:00:002019-12-162006-01-2268324available20
20{"id":1,"name":"Regular Season"}220:30:002019-12-162005-10-2669164available11
30{"id":1,"name":"Regular Season"}221:00:002019-12-162005-12-2068323available17
40{"id":1,"name":"Regular Season"}322:00:002019-12-162005-10-2268318available8
51{"id":1,"name":"Regular Season"}219:00:002019-12-162006-01-1568342available19
61{"id":1,"name":"Regular Season"}221:00:002020-02-272005-12-1168321available15
71{"id":1,"name":"Regular Season"}421:00:002019-12-162005-11-2768354available13
81{"id":1,"name":"Regular Season"}522:00:002019-12-162006-02-1869172available24
92{"id":1,"name":"Regular Season"}019:00:002019-12-162005-12-0468320available14
102{"id":1,"name":"Regular Season"}022:00:002019-12-162006-02-2568351available25
112{"id":1,"name":"Regular Season"}122:00:002019-12-162006-01-0768348available18
122{"id":1,"name":"Regular Season"}220:00:002019-12-162005-10-0168317available6
133{"id":1,"name":"Regular Season"}019:00:002019-12-162006-01-2968325available21
143{"id":1,"name":"Regular Season"}020:00:002019-12-162005-11-1968319available12
153{"id":1,"name":"Regular Season"}119:00:002019-12-162006-02-0568350available22
163{"id":1,"name":"Regular Season"}121:00:002019-12-162005-11-0668339available10
173{"id":1,"name":"Regular Season"}122:00:002019-12-162005-12-1768322available16
Rows: 1-17 | Columns: 14

As with a normal vDataFrame, we can easily extract the values from the sub-columns:

[8]:
data["away_team"]["away_team_gender"]
[8]:
Abc
away_team_gender
Varchar(80)
1male
2male
3male
4male
5male
6male
7male
8male
9male
10male
11male
12male
13male
14male
15male
16male
17male
Rows: 17 | Column: away_team_gender | Type: Varchar(80)

We can view any nested data structure by index:

[9]:
data["competition"]["competition_id"]
[9]:
123
competition_id
Integer
111
211
311
411
511
611
711
811
911
1011
1111
1211
1311
1411
1511
1611
1711
Rows: 17 | Column: competition_id | Type: Integer

These nested structures can be used to create features:

[10]:
data["name_home"] = data["home_team"]["home_team_name"]

We can even flatten the nested structure inside a json file, either flattening the entire file or just particular columns:

[17]:
data = vp.read_json(path = path + "laliga/2008.json",
                    table_name = "laliga_flat",
                    schema = "complex_vmap_test",
                    ingest_local = False,
                    flatten_maps = True,)
data
The table "complex_vmap_test"."laliga_flat" has been successfully created.
[17]:
Abc
Vmap(368)
Abc
Vmap(378)
Abc
season.season_name
Varchar(20)
123
season.season_id
Int
123
metadata.xy_fidelity_version
Int
123
metadata.shot_fidelity_version
Int
📅
metadata.data_version
Date
123
match_week
Int
Abc
match_status
Varchar(20)
123
match_id
Int
📅
match_date
Date
📅
last_updated
Timestamp
📅
kick_off
Time
Abc
home_team.home_team_name
Varchar(34)
123
home_team.home_team_id
Int
Abc
home_team.home_team_group
Varchar(20)
Abc
home_team.home_team_gender
Varchar(20)
Abc
home_team.country.name
Varchar(20)
123
home_team.country.id
Int
123
home_score
Int
Abc
competition_stage.name
Varchar(28)
123
competition_stage.id
Int
Abc
competition.country_name
Varchar(20)
Abc
competition.competition_name
Varchar(20)
123
competition.competition_id
Int
Abc
away_team.country.name
Varchar(20)
123
away_team.country.id
Int
Abc
away_team.away_team_name
Varchar(38)
123
away_team.away_team_id
Int
Abc
away_team.away_team_group
Varchar(20)
Abc
away_team.away_team_gender
Varchar(20)
123
away_score
Int
12008/200941222000-01-011available691472008-08-312019-12-16 23:09:16.16875619:00:00Numancia444[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male0
22008/200941222000-01-012available692152008-09-132019-12-16 23:09:16.16875620:00:00Barcelona217[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Racing Santander1217[null]male1
32008/200941222000-01-013available691382008-09-212019-12-16 23:09:16.16875621:00:00Sporting Gijón1041[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male6
42008/200941222000-01-014available692072008-09-242019-12-16 23:09:16.16875620:00:00Barcelona217[null]maleSpain2143Regular Season1SpainLa Liga11Spain214Real Betis218[null]male2
52008/200941222000-01-015available692112008-09-272019-12-16 23:09:16.16875622:00:00Espanyol214[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
62008/200941222000-01-016available692122008-10-042019-12-16 23:09:16.16875622:00:00Barcelona217[null]maleSpain2146Regular Season1SpainLa Liga11Spain214Atlético Madrid212[null]male1
72008/200941222000-01-018available692322008-10-252019-12-16 23:09:16.16875622:00:00Barcelona217[null]maleSpain2145Regular Season1SpainLa Liga11Spain214Almería403[null]male0
82008/200941222000-01-019available692352008-11-012019-12-16 23:09:16.16875620:00:00Málaga223[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male4
92008/200941222000-01-0110available692792008-11-082019-12-16 23:09:16.16875622:00:00Barcelona217[null]maleSpain2146Regular Season1SpainLa Liga11Spain214Real Valladolid901[null]male0
102008/200941222000-01-0111available692852008-11-162019-12-16 23:09:16.16875621:00:00Recreativo Huelva1220[null]maleSpain2140Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
112008/200941222000-01-0113available691712008-11-292019-12-16 23:09:16.16875622:00:00Sevilla213[null]maleSpain2140Regular Season1SpainLa Liga11Spain214Barcelona217[null]male3
122008/200941222000-01-0114available691492008-12-062019-12-16 23:09:16.16875622:00:00Barcelona217[null]maleSpain2144Regular Season1SpainLa Liga11Spain214Valencia207[null]male0
132008/200941222000-01-0115available692252008-12-132019-12-16 23:09:16.16875622:00:00Barcelona217[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Real Madrid220[null]male0
142008/200941222000-01-0116available692282008-12-212019-12-16 23:09:16.16875619:00:00Villarreal222[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
152008/200941222000-01-0118available692302009-01-112019-12-16 23:09:16.16875621:00:00Osasuna422[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Barcelona217[null]male3
162008/200941222000-01-0119available691832009-01-172019-12-16 23:09:16.16875620:00:00Barcelona217[null]maleSpain2145Regular Season1SpainLa Liga11Spain214Deportivo La Coruna219[null]male0
172008/200941222000-01-0120available691892009-01-242019-12-16 23:09:16.16875622:00:00Barcelona217[null]maleSpain2144Regular Season1SpainLa Liga11Spain214Numancia444[null]male1
182008/200941222000-01-0121available692092009-02-012019-12-16 23:09:16.16875617:00:00Racing Santander1217[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
192008/200941222000-01-0122available692312009-02-082019-12-16 23:09:16.16875619:00:00Barcelona217[null]maleSpain2143Regular Season1SpainLa Liga11Spain214Sporting Gijón1041[null]male1
202008/200941222000-01-0123available691952009-02-142019-12-16 23:09:16.16875620:00:00Real Betis218[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
212008/200941222000-01-0124available691392009-02-212019-12-16 23:09:16.16875620:00:00Barcelona217[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Espanyol214[null]male2
222008/200941222000-01-0125available691852009-03-012019-12-16 23:09:16.16875619:00:00Atlético Madrid212[null]maleSpain2144Regular Season1SpainLa Liga11Spain214Barcelona217[null]male3
232008/200941222000-01-0126available692162009-03-072019-12-16 23:09:16.16875620:00:00Barcelona217[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Athletic Bilbao215[null]male0
242008/200941222000-01-0127available691772009-03-152019-12-16 23:09:16.16875621:03:00Almería403[null]maleSpain2140Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
252008/200941222000-01-0128available691422009-03-222019-12-16 23:09:16.16875619:00:00Barcelona217[null]maleSpain2146Regular Season1SpainLa Liga11Spain214Málaga223[null]male0
262008/200941222000-01-0129available692732009-04-042019-12-16 23:09:16.16875620:00:00Real Valladolid901[null]maleSpain2140Regular Season1SpainLa Liga11Spain214Barcelona217[null]male1
272008/200941222000-01-0130available692222009-04-112019-12-16 23:09:16.16875620:00:00Barcelona217[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Recreativo Huelva1220[null]male0
282008/200941222000-01-0131available692232009-04-182019-12-16 23:09:16.16875620:00:00Getafe216[null]maleSpain2140Regular Season1SpainLa Liga11Spain214Barcelona217[null]male1
292008/200941222000-01-0133available692512009-04-252019-12-16 23:09:16.16875622:00:00Valencia207[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
302008/200941222000-01-0134available692492009-05-022019-12-16 23:09:16.16875620:00:00Real Madrid220[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Barcelona217[null]male6
312008/200941222000-01-0135available692172009-05-102019-12-16 23:09:16.16875619:03:00Barcelona217[null]maleSpain2143Regular Season1SpainLa Liga11Spain214Villarreal222[null]male3
Rows: 1-31 | Columns: 32

We can see that all the columns from the JSON file have been flattened and multiple columns have been created for each sub-column. This causes some loss in data structure, but makes it easy to see the data and to use it for model building.

It is important to note that the data type of certain columns (home_team.managers) is now VMap, and not the ROW type that we saw in the above cells. Even though both are used to capture nested data, there is in a subtle difference between the two.

VMap: More flexible as it stores the data as a string of maps, allowing the ingestion of data in varying shapes. The shape is not fixed and new keys can easily be handled. This is a great option when we don’t know the structure in advance, or if the structure changes over time.

Row: More rigid because the dictionaries, including all the data types, are fixed when they are defined. Newly parsed keys are ignored. But because of it’s rigid structure, it is much more performant than VMaps. They are best used when the file structure is known in advance.

To deconvolve the nested structure, we can use the ‘flatten_arrays’ parameter in order to make the output strictly formatted. However, it can be an expensive process.

[19]:
vp.drop("complex_vmap_test.laliga_flat")
data = vp.read_json(path = path + "laliga/2008.json",
                    table_name = "laliga_flat",
                    schema = "complex_vmap_test",
                    ingest_local = False,
                    flatten_arrays=True,)
data
The table "complex_vmap_test"."laliga_flat" has been successfully created.
[19]:
Abc
home_team.managers.0.nickname
Varchar(42)
Abc
home_team.managers.0.name
Varchar(64)
123
home_team.managers.0.id
Int
📅
home_team.managers.0.dob
Date
Abc
Varchar(20)
123
home_team.managers.0.country.id
Int
Abc
away_team.managers.0.nickname
Varchar(42)
Abc
Varchar(72)
123
away_team.managers.0.id
Int
📅
away_team.managers.0.dob
Date
Abc
Varchar(20)
123
away_team.managers.0.country.id
Int
Abc
season.season_name
Varchar(20)
123
season.season_id
Int
123
metadata.xy_fidelity_version
Int
123
metadata.shot_fidelity_version
Int
📅
metadata.data_version
Date
123
match_week
Int
Abc
match_status
Varchar(20)
123
match_id
Int
📅
match_date
Date
📅
last_updated
Timestamp
📅
kick_off
Time
Abc
home_team.home_team_name
Varchar(34)
123
home_team.home_team_id
Int
Abc
home_team.home_team_group
Varchar(20)
Abc
home_team.home_team_gender
Varchar(20)
Abc
home_team.country.name
Varchar(20)
123
home_team.country.id
Int
123
home_score
Int
Abc
competition_stage.name
Varchar(28)
123
competition_stage.id
Int
Abc
competition.country_name
Varchar(20)
Abc
competition.competition_name
Varchar(20)
123
competition.competition_id
Int
Abc
away_team.country.name
Varchar(20)
123
away_team.country.id
Int
Abc
away_team.away_team_name
Varchar(38)
123
away_team.away_team_id
Int
Abc
away_team.away_team_group
Varchar(20)
Abc
away_team.away_team_gender
Varchar(20)
123
away_score
Int
1José Luis MendilibarJosé Luis Mendilibar Etxebarria221[null]214Pep Guardiola36[null]2142008/200941222000-01-0129available692732009-04-042019-12-16 23:09:16.16875620:00:00Real Valladolid901[null]maleSpain2140Regular Season1SpainLa Liga11Spain214Barcelona217[null]male1
2Juan MuñizJuan Ramón López Muñiz21968-11-02214Pep Guardiola36[null]2142008/200941222000-01-0121available692092009-02-012019-12-16 23:09:16.16875617:00:00Racing Santander1217[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
3Juande RamosJuan de la Cruz Ramos Cano3899[null]214Pep Guardiola36[null]2142008/200941222000-01-0134available692492009-05-022019-12-16 23:09:16.16875620:00:00Real Madrid220[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Barcelona217[null]male6
4Lucas AlcarazLuis Lucas Alcaraz González1612[null]214Pep Guardiola36[null]2142008/200941222000-01-0111available692852008-11-162019-12-16 23:09:16.16875621:00:00Recreativo Huelva1220[null]maleSpain2140Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
5Manolo JiménezManuel Enrique Jiménez Jiménez16211964-01-26214Pep Guardiola36[null]2142008/200941222000-01-0113available691712008-11-292019-12-16 23:09:16.16875622:00:00Sevilla213[null]maleSpain2140Regular Season1SpainLa Liga11Spain214Barcelona217[null]male3
6Manuel PellegriniManuel Luis Pellegrini Ripamonti733[null]45Pep Guardiola36[null]2142008/200941222000-01-0116available692282008-12-212019-12-16 23:09:16.16875619:00:00Villarreal222[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
7Pep GuardiolaJosep Guardiola i Sala36[null]214Javier Aguirre3196[null]1472008/200941222000-01-016available692122008-10-042019-12-16 23:09:16.16875622:00:00Barcelona217[null]maleSpain2146Regular Season1SpainLa Liga11Spain214Atlético Madrid212[null]male1
8Pep GuardiolaJosep Guardiola i Sala36[null]214Joaquín Caparrós4971955-10-132142008/200941222000-01-0126available692162009-03-072019-12-16 23:09:16.16875620:00:00Barcelona217[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Athletic Bilbao215[null]male0
9Pep GuardiolaJosep Guardiola i Sala36[null]214José Luis Mendilibar221[null]2142008/200941222000-01-0110available692792008-11-082019-12-16 23:09:16.16875622:00:00Barcelona217[null]maleSpain2146Regular Season1SpainLa Liga11Spain214Real Valladolid901[null]male0
10Pep GuardiolaJosep Guardiola i Sala36[null]214Juan Muñiz21968-11-022142008/200941222000-01-012available692152008-09-132019-12-16 23:09:16.16875620:00:00Barcelona217[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Racing Santander1217[null]male1
11Pep GuardiolaJosep Guardiola i Sala36[null]214Juande Ramos3899[null]2142008/200941222000-01-0115available692252008-12-132019-12-16 23:09:16.16875622:00:00Barcelona217[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Real Madrid220[null]male0
12Pep GuardiolaJosep Guardiola i Sala36[null]214Lucas Alcaraz1612[null]2142008/200941222000-01-0130available692222009-04-112019-12-16 23:09:16.16875620:00:00Barcelona217[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Recreativo Huelva1220[null]male0
13Pep GuardiolaJosep Guardiola i Sala36[null]214Manuel Pellegrini733[null]452008/200941222000-01-0135available692172009-05-102019-12-16 23:09:16.16875619:03:00Barcelona217[null]maleSpain2143Regular Season1SpainLa Liga11Spain214Villarreal222[null]male3
14Pep GuardiolaJosep Guardiola i Sala36[null]214Mauricio Pochettino81[null]112008/200941222000-01-0124available691392009-02-212019-12-16 23:09:16.16875620:00:00Barcelona217[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Espanyol214[null]male2
15Pep GuardiolaJosep Guardiola i Sala36[null]214Miguel Ángel Lotina4519[null]2142008/200941222000-01-0119available691832009-01-172019-12-16 23:09:16.16875620:00:00Barcelona217[null]maleSpain2145Regular Season1SpainLa Liga11Spain214Deportivo La Coruna219[null]male0
16Pep GuardiolaJosep Guardiola i Sala36[null]214Unai Emery21[null]2142008/200941222000-01-0114available691492008-12-062019-12-16 23:09:16.16875622:00:00Barcelona217[null]maleSpain2144Regular Season1SpainLa Liga11Spain214Valencia207[null]male0
17Unai EmeryUnai Emery Etxegoien21[null]214Pep Guardiola36[null]2142008/200941222000-01-0133available692512009-04-252019-12-16 23:09:16.16875622:00:00Valencia207[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
18[null][null][null][null][null][null][null][null][null]2008/200941222000-01-0128available691422009-03-222019-12-16 23:09:16.16875619:00:00Barcelona217[null]maleSpain2146Regular Season1SpainLa Liga11Spain214Málaga223[null]male0
19[null][null][null][null][null][null][null][null][null]2008/200941222000-01-011available691472008-08-312019-12-16 23:09:16.16875619:00:00Numancia444[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male0
20[null][null][null][null][null][null][null][null][null]2008/200941222000-01-013available691382008-09-212019-12-16 23:09:16.16875621:00:00Sporting Gijón1041[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male6
21[null][null][null][null][null][null][null][null][null]2008/200941222000-01-0120available691892009-01-242019-12-16 23:09:16.16875622:00:00Barcelona217[null]maleSpain2144Regular Season1SpainLa Liga11Spain214Numancia444[null]male1
22[null][null][null][null][null][null][null][null][null]2008/200941222000-01-0131available692232009-04-182019-12-16 23:09:16.16875620:00:00Getafe216[null]maleSpain2140Regular Season1SpainLa Liga11Spain214Barcelona217[null]male1
23[null][null][null][null][null][null][null][null][null]2008/200941222000-01-0125available691852009-03-012019-12-16 23:09:16.16875619:00:00Atlético Madrid212[null]maleSpain2144Regular Season1SpainLa Liga11Spain214Barcelona217[null]male3
24[null][null][null][null][null][null][null][null][null]2008/200941222000-01-0127available691772009-03-152019-12-16 23:09:16.16875621:03:00Almería403[null]maleSpain2140Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
25[null][null][null][null][null][null][null][null][null]2008/200941222000-01-0122available692312009-02-082019-12-16 23:09:16.16875619:00:00Barcelona217[null]maleSpain2143Regular Season1SpainLa Liga11Spain214Sporting Gijón1041[null]male1
26[null][null][null][null][null][null][null][null][null]2008/200941222000-01-0123available691952009-02-142019-12-16 23:09:16.16875620:00:00Real Betis218[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
27[null][null][null][null][null][null][null][null][null]2008/200941222000-01-0118available692302009-01-112019-12-16 23:09:16.16875621:00:00Osasuna422[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Barcelona217[null]male3
28[null][null][null][null][null][null][null][null][null]2008/200941222000-01-014available692072008-09-242019-12-16 23:09:16.16875620:00:00Barcelona217[null]maleSpain2143Regular Season1SpainLa Liga11Spain214Real Betis218[null]male2
29[null][null][null][null][null][null][null][null][null]2008/200941222000-01-019available692352008-11-012019-12-16 23:09:16.16875620:00:00Málaga223[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male4
30[null][null][null][null][null][null][null][null][null]2008/200941222000-01-018available692322008-10-252019-12-16 23:09:16.16875622:00:00Barcelona217[null]maleSpain2145Regular Season1SpainLa Liga11Spain214Almería403[null]male0
31[null][null][null][null][null][null][null][null][null]2008/200941222000-01-015available692112008-09-272019-12-16 23:09:16.16875622:00:00Espanyol214[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
Rows: 1-31 | Columns: 42

We can even convert columns into other formats, such as string:

[20]:
data["home_team.managers.0.nickname"].astype(str)
[20]:
Abc
home_team.managers.0.nickname
Varchar
Abc
home_team.managers.0.name
Varchar(64)
123
home_team.managers.0.id
Int
📅
home_team.managers.0.dob
Date
Abc
Varchar(20)
123
home_team.managers.0.country.id
Int
Abc
away_team.managers.0.nickname
Varchar(42)
Abc
Varchar(72)
123
away_team.managers.0.id
Int
📅
away_team.managers.0.dob
Date
Abc
Varchar(20)
123
away_team.managers.0.country.id
Int
Abc
season.season_name
Varchar(20)
123
season.season_id
Int
123
metadata.xy_fidelity_version
Int
123
metadata.shot_fidelity_version
Int
📅
metadata.data_version
Date
123
match_week
Int
Abc
match_status
Varchar(20)
123
match_id
Int
📅
match_date
Date
📅
last_updated
Timestamp
📅
kick_off
Time
Abc
home_team.home_team_name
Varchar(34)
123
home_team.home_team_id
Int
Abc
home_team.home_team_group
Varchar(20)
Abc
home_team.home_team_gender
Varchar(20)
Abc
home_team.country.name
Varchar(20)
123
home_team.country.id
Int
123
home_score
Int
Abc
competition_stage.name
Varchar(28)
123
competition_stage.id
Int
Abc
competition.country_name
Varchar(20)
Abc
competition.competition_name
Varchar(20)
123
competition.competition_id
Int
Abc
away_team.country.name
Varchar(20)
123
away_team.country.id
Int
Abc
away_team.away_team_name
Varchar(38)
123
away_team.away_team_id
Int
Abc
away_team.away_team_group
Varchar(20)
Abc
away_team.away_team_gender
Varchar(20)
123
away_score
Int
1José Luis MendilibarJosé Luis Mendilibar Etxebarria221[null]214Pep Guardiola36[null]2142008/200941222000-01-0129available692732009-04-042019-12-16 23:09:16.16875620:00:00Real Valladolid901[null]maleSpain2140Regular Season1SpainLa Liga11Spain214Barcelona217[null]male1
2Juan MuñizJuan Ramón López Muñiz21968-11-02214Pep Guardiola36[null]2142008/200941222000-01-0121available692092009-02-012019-12-16 23:09:16.16875617:00:00Racing Santander1217[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
3Juande RamosJuan de la Cruz Ramos Cano3899[null]214Pep Guardiola36[null]2142008/200941222000-01-0134available692492009-05-022019-12-16 23:09:16.16875620:00:00Real Madrid220[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Barcelona217[null]male6
4Lucas AlcarazLuis Lucas Alcaraz González1612[null]214Pep Guardiola36[null]2142008/200941222000-01-0111available692852008-11-162019-12-16 23:09:16.16875621:00:00Recreativo Huelva1220[null]maleSpain2140Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
5Manolo JiménezManuel Enrique Jiménez Jiménez16211964-01-26214Pep Guardiola36[null]2142008/200941222000-01-0113available691712008-11-292019-12-16 23:09:16.16875622:00:00Sevilla213[null]maleSpain2140Regular Season1SpainLa Liga11Spain214Barcelona217[null]male3
6Manuel PellegriniManuel Luis Pellegrini Ripamonti733[null]45Pep Guardiola36[null]2142008/200941222000-01-0116available692282008-12-212019-12-16 23:09:16.16875619:00:00Villarreal222[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
7Pep GuardiolaJosep Guardiola i Sala36[null]214Javier Aguirre3196[null]1472008/200941222000-01-016available692122008-10-042019-12-16 23:09:16.16875622:00:00Barcelona217[null]maleSpain2146Regular Season1SpainLa Liga11Spain214Atlético Madrid212[null]male1
8Pep GuardiolaJosep Guardiola i Sala36[null]214Joaquín Caparrós4971955-10-132142008/200941222000-01-0126available692162009-03-072019-12-16 23:09:16.16875620:00:00Barcelona217[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Athletic Bilbao215[null]male0
9Pep GuardiolaJosep Guardiola i Sala36[null]214José Luis Mendilibar221[null]2142008/200941222000-01-0110available692792008-11-082019-12-16 23:09:16.16875622:00:00Barcelona217[null]maleSpain2146Regular Season1SpainLa Liga11Spain214Real Valladolid901[null]male0
10Pep GuardiolaJosep Guardiola i Sala36[null]214Juan Muñiz21968-11-022142008/200941222000-01-012available692152008-09-132019-12-16 23:09:16.16875620:00:00Barcelona217[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Racing Santander1217[null]male1
11Pep GuardiolaJosep Guardiola i Sala36[null]214Juande Ramos3899[null]2142008/200941222000-01-0115available692252008-12-132019-12-16 23:09:16.16875622:00:00Barcelona217[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Real Madrid220[null]male0
12Pep GuardiolaJosep Guardiola i Sala36[null]214Lucas Alcaraz1612[null]2142008/200941222000-01-0130available692222009-04-112019-12-16 23:09:16.16875620:00:00Barcelona217[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Recreativo Huelva1220[null]male0
13Pep GuardiolaJosep Guardiola i Sala36[null]214Manuel Pellegrini733[null]452008/200941222000-01-0135available692172009-05-102019-12-16 23:09:16.16875619:03:00Barcelona217[null]maleSpain2143Regular Season1SpainLa Liga11Spain214Villarreal222[null]male3
14Pep GuardiolaJosep Guardiola i Sala36[null]214Mauricio Pochettino81[null]112008/200941222000-01-0124available691392009-02-212019-12-16 23:09:16.16875620:00:00Barcelona217[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Espanyol214[null]male2
15Pep GuardiolaJosep Guardiola i Sala36[null]214Miguel Ángel Lotina4519[null]2142008/200941222000-01-0119available691832009-01-172019-12-16 23:09:16.16875620:00:00Barcelona217[null]maleSpain2145Regular Season1SpainLa Liga11Spain214Deportivo La Coruna219[null]male0
16Pep GuardiolaJosep Guardiola i Sala36[null]214Unai Emery21[null]2142008/200941222000-01-0114available691492008-12-062019-12-16 23:09:16.16875622:00:00Barcelona217[null]maleSpain2144Regular Season1SpainLa Liga11Spain214Valencia207[null]male0
17Unai EmeryUnai Emery Etxegoien21[null]214Pep Guardiola36[null]2142008/200941222000-01-0133available692512009-04-252019-12-16 23:09:16.16875622:00:00Valencia207[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
18[null][null][null][null][null][null][null][null][null]2008/200941222000-01-0128available691422009-03-222019-12-16 23:09:16.16875619:00:00Barcelona217[null]maleSpain2146Regular Season1SpainLa Liga11Spain214Málaga223[null]male0
19[null][null][null][null][null][null][null][null][null]2008/200941222000-01-011available691472008-08-312019-12-16 23:09:16.16875619:00:00Numancia444[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male0
20[null][null][null][null][null][null][null][null][null]2008/200941222000-01-013available691382008-09-212019-12-16 23:09:16.16875621:00:00Sporting Gijón1041[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male6
21[null][null][null][null][null][null][null][null][null]2008/200941222000-01-0120available691892009-01-242019-12-16 23:09:16.16875622:00:00Barcelona217[null]maleSpain2144Regular Season1SpainLa Liga11Spain214Numancia444[null]male1
22[null][null][null][null][null][null][null][null][null]2008/200941222000-01-0131available692232009-04-182019-12-16 23:09:16.16875620:00:00Getafe216[null]maleSpain2140Regular Season1SpainLa Liga11Spain214Barcelona217[null]male1
23[null][null][null][null][null][null][null][null][null]2008/200941222000-01-0125available691852009-03-012019-12-16 23:09:16.16875619:00:00Atlético Madrid212[null]maleSpain2144Regular Season1SpainLa Liga11Spain214Barcelona217[null]male3
24[null][null][null][null][null][null][null][null][null]2008/200941222000-01-0127available691772009-03-152019-12-16 23:09:16.16875621:03:00Almería403[null]maleSpain2140Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
25[null][null][null][null][null][null][null][null][null]2008/200941222000-01-0122available692312009-02-082019-12-16 23:09:16.16875619:00:00Barcelona217[null]maleSpain2143Regular Season1SpainLa Liga11Spain214Sporting Gijón1041[null]male1
26[null][null][null][null][null][null][null][null][null]2008/200941222000-01-0123available691952009-02-142019-12-16 23:09:16.16875620:00:00Real Betis218[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
27[null][null][null][null][null][null][null][null][null]2008/200941222000-01-0118available692302009-01-112019-12-16 23:09:16.16875621:00:00Osasuna422[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Barcelona217[null]male3
28[null][null][null][null][null][null][null][null][null]2008/200941222000-01-014available692072008-09-242019-12-16 23:09:16.16875620:00:00Barcelona217[null]maleSpain2143Regular Season1SpainLa Liga11Spain214Real Betis218[null]male2
29[null][null][null][null][null][null][null][null][null]2008/200941222000-01-019available692352008-11-012019-12-16 23:09:16.16875620:00:00Málaga223[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male4
30[null][null][null][null][null][null][null][null][null]2008/200941222000-01-018available692322008-10-252019-12-16 23:09:16.16875622:00:00Barcelona217[null]maleSpain2145Regular Season1SpainLa Liga11Spain214Almería403[null]male0
31[null][null][null][null][null][null][null][null][null]2008/200941222000-01-015available692112008-09-272019-12-16 23:09:16.16875622:00:00Espanyol214[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
Rows: 1-31 | Columns: 42

Or integer:

[47]:
data["match_week"].astype(int)
[47]:
Abc
home_team.managers.0.nickname
Varchar
Abc
home_team.managers.0.name
Varchar(64)
123
home_team.managers.0.id
Int
📅
home_team.managers.0.dob
Date
Abc
Varchar(20)
123
home_team.managers.0.country.id
Int
Abc
away_team.managers.0.nickname
Varchar(42)
Abc
Varchar(72)
123
away_team.managers.0.id
Int
📅
away_team.managers.0.dob
Date
Abc
Varchar(20)
123
away_team.managers.0.country.id
Int
Abc
season.season_name
Varchar(20)
123
season.season_id
Int
123
metadata.xy_fidelity_version
Int
123
metadata.shot_fidelity_version
Int
📅
metadata.data_version
Date
123
match_week
Int
Abc
match_status
Varchar(20)
123
match_id
Int
📅
match_date
Date
📅
last_updated
Timestamp
📅
kick_off
Time
Abc
home_team.home_team_name
Varchar(34)
123
home_team.home_team_id
Int
Abc
home_team.home_team_group
Varchar(20)
Abc
home_team.home_team_gender
Varchar(20)
Abc
home_team.country.name
Varchar(20)
123
home_team.country.id
Int
123
home_score
Int
Abc
competition_stage.name
Varchar(28)
123
competition_stage.id
Int
Abc
competition.country_name
Varchar(20)
Abc
competition.competition_name
Varchar(20)
123
competition.competition_id
Int
Abc
away_team.country.name
Varchar(20)
123
away_team.country.id
Int
Abc
away_team.away_team_name
Varchar(38)
123
away_team.away_team_id
Int
Abc
away_team.away_team_group
Varchar(20)
Abc
away_team.away_team_gender
Varchar(20)
123
away_score
Int
1José Luis MendilibarJosé Luis Mendilibar Etxebarria221[null]214Pep Guardiola36[null]2142008/200941222000-01-0129available692732009-04-042019-12-16 23:09:16.16875620:00:00Real Valladolid901[null]maleSpain2140Regular Season1SpainLa Liga11Spain214Barcelona217[null]male1
2Juan MuñizJuan Ramón López Muñiz21968-11-02214Pep Guardiola36[null]2142008/200941222000-01-0121available692092009-02-012019-12-16 23:09:16.16875617:00:00Racing Santander1217[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
3Juande RamosJuan de la Cruz Ramos Cano3899[null]214Pep Guardiola36[null]2142008/200941222000-01-0134available692492009-05-022019-12-16 23:09:16.16875620:00:00Real Madrid220[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Barcelona217[null]male6
4Lucas AlcarazLuis Lucas Alcaraz González1612[null]214Pep Guardiola36[null]2142008/200941222000-01-0111available692852008-11-162019-12-16 23:09:16.16875621:00:00Recreativo Huelva1220[null]maleSpain2140Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
5Manolo JiménezManuel Enrique Jiménez Jiménez16211964-01-26214Pep Guardiola36[null]2142008/200941222000-01-0113available691712008-11-292019-12-16 23:09:16.16875622:00:00Sevilla213[null]maleSpain2140Regular Season1SpainLa Liga11Spain214Barcelona217[null]male3
6Manuel PellegriniManuel Luis Pellegrini Ripamonti733[null]45Pep Guardiola36[null]2142008/200941222000-01-0116available692282008-12-212019-12-16 23:09:16.16875619:00:00Villarreal222[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
7Pep GuardiolaJosep Guardiola i Sala36[null]214Javier Aguirre3196[null]1472008/200941222000-01-016available692122008-10-042019-12-16 23:09:16.16875622:00:00Barcelona217[null]maleSpain2146Regular Season1SpainLa Liga11Spain214Atlético Madrid212[null]male1
8Pep GuardiolaJosep Guardiola i Sala36[null]214Joaquín Caparrós4971955-10-132142008/200941222000-01-0126available692162009-03-072019-12-16 23:09:16.16875620:00:00Barcelona217[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Athletic Bilbao215[null]male0
9Pep GuardiolaJosep Guardiola i Sala36[null]214José Luis Mendilibar221[null]2142008/200941222000-01-0110available692792008-11-082019-12-16 23:09:16.16875622:00:00Barcelona217[null]maleSpain2146Regular Season1SpainLa Liga11Spain214Real Valladolid901[null]male0
10Pep GuardiolaJosep Guardiola i Sala36[null]214Juan Muñiz21968-11-022142008/200941222000-01-012available692152008-09-132019-12-16 23:09:16.16875620:00:00Barcelona217[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Racing Santander1217[null]male1
11Pep GuardiolaJosep Guardiola i Sala36[null]214Juande Ramos3899[null]2142008/200941222000-01-0115available692252008-12-132019-12-16 23:09:16.16875622:00:00Barcelona217[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Real Madrid220[null]male0
12Pep GuardiolaJosep Guardiola i Sala36[null]214Lucas Alcaraz1612[null]2142008/200941222000-01-0130available692222009-04-112019-12-16 23:09:16.16875620:00:00Barcelona217[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Recreativo Huelva1220[null]male0
13Pep GuardiolaJosep Guardiola i Sala36[null]214Manuel Pellegrini733[null]452008/200941222000-01-0135available692172009-05-102019-12-16 23:09:16.16875619:03:00Barcelona217[null]maleSpain2143Regular Season1SpainLa Liga11Spain214Villarreal222[null]male3
14Pep GuardiolaJosep Guardiola i Sala36[null]214Mauricio Pochettino81[null]112008/200941222000-01-0124available691392009-02-212019-12-16 23:09:16.16875620:00:00Barcelona217[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Espanyol214[null]male2
15Pep GuardiolaJosep Guardiola i Sala36[null]214Miguel Ángel Lotina4519[null]2142008/200941222000-01-0119available691832009-01-172019-12-16 23:09:16.16875620:00:00Barcelona217[null]maleSpain2145Regular Season1SpainLa Liga11Spain214Deportivo La Coruna219[null]male0
16Pep GuardiolaJosep Guardiola i Sala36[null]214Unai Emery21[null]2142008/200941222000-01-0114available691492008-12-062019-12-16 23:09:16.16875622:00:00Barcelona217[null]maleSpain2144Regular Season1SpainLa Liga11Spain214Valencia207[null]male0
17Unai EmeryUnai Emery Etxegoien21[null]214Pep Guardiola36[null]2142008/200941222000-01-0133available692512009-04-252019-12-16 23:09:16.16875622:00:00Valencia207[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
18[null][null][null][null][null][null][null][null][null]2008/200941222000-01-0128available691422009-03-222019-12-16 23:09:16.16875619:00:00Barcelona217[null]maleSpain2146Regular Season1SpainLa Liga11Spain214Málaga223[null]male0
19[null][null][null][null][null][null][null][null][null]2008/200941222000-01-011available691472008-08-312019-12-16 23:09:16.16875619:00:00Numancia444[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male0
20[null][null][null][null][null][null][null][null][null]2008/200941222000-01-013available691382008-09-212019-12-16 23:09:16.16875621:00:00Sporting Gijón1041[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male6
21[null][null][null][null][null][null][null][null][null]2008/200941222000-01-0120available691892009-01-242019-12-16 23:09:16.16875622:00:00Barcelona217[null]maleSpain2144Regular Season1SpainLa Liga11Spain214Numancia444[null]male1
22[null][null][null][null][null][null][null][null][null]2008/200941222000-01-0131available692232009-04-182019-12-16 23:09:16.16875620:00:00Getafe216[null]maleSpain2140Regular Season1SpainLa Liga11Spain214Barcelona217[null]male1
23[null][null][null][null][null][null][null][null][null]2008/200941222000-01-0125available691852009-03-012019-12-16 23:09:16.16875619:00:00Atlético Madrid212[null]maleSpain2144Regular Season1SpainLa Liga11Spain214Barcelona217[null]male3
24[null][null][null][null][null][null][null][null][null]2008/200941222000-01-0127available691772009-03-152019-12-16 23:09:16.16875621:03:00Almería403[null]maleSpain2140Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
25[null][null][null][null][null][null][null][null][null]2008/200941222000-01-0122available692312009-02-082019-12-16 23:09:16.16875619:00:00Barcelona217[null]maleSpain2143Regular Season1SpainLa Liga11Spain214Sporting Gijón1041[null]male1
26[null][null][null][null][null][null][null][null][null]2008/200941222000-01-0123available691952009-02-142019-12-16 23:09:16.16875620:00:00Real Betis218[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
27[null][null][null][null][null][null][null][null][null]2008/200941222000-01-0118available692302009-01-112019-12-16 23:09:16.16875621:00:00Osasuna422[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Barcelona217[null]male3
28[null][null][null][null][null][null][null][null][null]2008/200941222000-01-014available692072008-09-242019-12-16 23:09:16.16875620:00:00Barcelona217[null]maleSpain2143Regular Season1SpainLa Liga11Spain214Real Betis218[null]male2
29[null][null][null][null][null][null][null][null][null]2008/200941222000-01-019available692352008-11-012019-12-16 23:09:16.16875620:00:00Málaga223[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male4
30[null][null][null][null][null][null][null][null][null]2008/200941222000-01-018available692322008-10-252019-12-16 23:09:16.16875622:00:00Barcelona217[null]maleSpain2145Regular Season1SpainLa Liga11Spain214Almería403[null]male0
31[null][null][null][null][null][null][null][null][null]2008/200941222000-01-015available692112008-09-272019-12-16 23:09:16.16875622:00:00Espanyol214[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
Rows: 1-31 | Columns: 42

It is also possible to:

  • Cast str to array

  • Cast complex data types to json str

  • Cast str to VMAPs

  • And much more…

Multiple File Ingestion#

If we have multiple files with the same extension, we can easily ingest them using the “*” operator:

[7]:
data = vp.read_file(path = path + "laliga/*.json",
                    table_name = "laliga_all",
                    ingest_local = False,
                    schema = "complex_vmap_test",)
data
[7]:
123
away_score
Int
🛠
Row(away_team_gender varchar(80),away_team_group varchar(80),away_team_id int,away_team_name varchar(80),country row(id int,name
🛠
Row(competition_id int,competition_name varchar(80),country_name varchar(80))
🛠
Row(id int,name varchar(80))
123
home_score
Int
🛠
Row(country row(id int,name varchar(80)),home_team_gender varchar(80),home_team_group varchar(80),home_team_id int,home_team_nam
📅
kick_off
Time
📅
last_updated
Date
📅
match_date
Date
123
match_id
Int
Abc
match_status
Varchar(80)
123
match_week
Int
🛠
Row(data_version date,shot_fidelity_version int,xy_fidelity_version int)
🛠
Row(season_id int,season_name varchar(80))
10019:00:002019-12-162014-05-11266201available37
20020:00:002019-12-162013-10-19266462available9
30022:00:002019-12-162011-10-2269329available9
40022:00:002019-12-162012-01-2869338available21
50119:00:002019-12-162008-08-3169147available1
60120:30:002019-12-162015-08-29267422available2
70120:45:002019-12-162016-10-29267058available10
80120:45:002019-12-162019-04-2716289available35
90121:00:002019-12-162013-11-0170283available12
100121:30:002019-12-162012-09-0270286available3
110216:15:002020-04-212019-03-3016231available29
120220:00:002019-12-162009-03-0769216available26
130220:00:002019-12-162009-04-1169222available30
140220:00:002019-12-162011-04-2369271available33
150220:45:002019-12-162019-04-0616248available31
160319:00:002019-12-162010-03-1469224available26
170320:00:002019-12-162007-11-2469184available13
180320:00:002019-12-162014-10-18265896available8
190322:00:002019-12-162005-10-2268318available8
200322:00:002019-12-162011-02-0569276available22
210421:00:002019-12-162011-11-2969332available17
220421:00:002019-12-162012-04-1069343available33
230516:15:002019-12-162017-01-14267395available18
240520:00:002019-12-162009-01-1769183available19
250520:45:002019-12-162017-03-04266299available26
260521:00:002019-12-162010-12-1269302available15
270522:00:002019-12-162008-10-2569232available8
280616:00:002019-12-162016-03-12266498available29
290619:00:002019-12-162008-05-0469141available35
300619:00:002019-12-162009-03-2269142available28
310717:00:002019-12-162014-03-16266074available28
321019:00:002019-12-162014-08-31266406available2
331020:00:002019-12-162009-04-0469273available29
341020:00:002019-12-162011-10-2569318available10
351020:00:002019-12-162014-11-01267301available10
361020:15:002019-12-162016-08-28266892available2
371020:45:002019-12-162019-03-0216196available26
381021:00:002019-12-162014-11-30266560available13
391021:00:002019-12-162015-04-05266929available29
401116:15:002019-12-162016-12-03267076available14
411119:00:002019-12-162007-05-1369162available34
421120:30:002019-12-162015-12-05267274available14
431120:45:002019-12-162018-11-2416073available13
441122:00:002020-04-092011-04-1669245available32
451216:00:002019-12-162015-09-26267611available6
461218:00:002019-12-162013-10-2670293available10
471219:00:002019-12-162006-01-1568342available19
481220:00:002019-12-162010-02-0669240available21
490016:00:002019-12-162016-01-02266670available18
500020:00:002019-12-162008-04-1968359available33
510020:00:002019-12-162014-01-11265830available19
520022:00:002019-12-162009-10-1769252available7
530116:15:002019-12-162018-03-049837available27
540119:00:002019-12-162007-04-1569159available30
550119:00:002019-12-162007-04-2969156available32
560120:00:002019-12-162007-04-0769179available29
570121:00:002019-12-162008-01-2069173available20
580121:00:002019-12-162015-01-04266240available17
590216:15:002019-12-162018-03-189855available29
600218:30:002019-12-162018-12-0216079available14
610218:30:002019-12-162018-12-2216109available17
620219:00:002019-12-162005-05-0168316available34
630220:15:002020-02-262017-08-209575available1
640220:45:002019-12-162017-04-08267590available31
650220:45:002019-12-162017-10-219650available9
660221:00:002019-12-162005-12-2068323available17
670221:00:002019-12-162006-10-2268330available7
680316:15:002019-12-162017-02-04266874available21
690319:30:002019-12-162017-04-05266280available30
700320:00:002019-12-162011-10-1569293available8
710321:00:002019-12-162007-02-2568333available24
720416:00:002019-12-162015-11-28266885available13
730416:00:002019-12-162016-01-09266620available19
740419:00:002019-12-162013-01-06266433available18
750420:00:002019-12-162004-12-0468314available14
760422:00:002019-12-162008-12-0669149available14
770516:00:002019-12-162014-12-20266846available16
780517:00:002019-12-162015-02-15266741available23
790517:00:002019-12-162016-05-08265958available37
800520:00:002019-12-162011-10-2969314available11
810521:00:002019-12-162011-08-2969268available2
820522:00:002019-12-162010-10-3069289available9
830719:00:002019-12-162013-08-1870277available1
841016:00:002019-12-162015-02-21266148available24
851018:30:002019-12-162015-08-23266236available1
861020:00:002019-12-162009-04-1869223available31
871020:00:002019-12-162010-03-2769298available29
881022:00:002019-12-162011-03-0269274available26
891022:00:002019-12-162011-04-0269304available30
901119:00:002019-12-162008-01-2769181available21
911119:00:002019-12-162010-10-0369236available6
921119:00:002019-12-162013-02-0370282available22
931120:00:002019-12-162011-05-1169272available36
941120:45:002019-12-162017-01-08266477available17
951122:00:002019-12-162008-02-0969146available23
961122:00:002019-12-162016-09-21267220available5
971220:00:002019-12-162004-12-2168315available17
981220:00:002019-12-162011-04-3069246available34
991318:00:002019-12-162012-11-0370308available10
1001318:00:002019-12-162014-10-25267085available9
Rows: 1-100 | Columns: 14

We can also do this for other file types. For example, csv:

[44]:
data = vp.read_csv(path = path + "*.csv",
                   table_name = "cities_all",
                   schema = "complex_vmap_test",
                   ingest_local = False,
                   insert = True)
data
[44]:
Abc
name
Varchar(38)
Abc
Varchar(90)
1Abidjan
2Abidjan
3Abu Dhabi
4Abu Dhabi
5Abuja
6Abuja
7Accra
8Accra
9Addis Ababa
10Addis Ababa
11Algiers
12Algiers
13Amman
14Amman
15Amsterdam
16Amsterdam
17Andorra
18Andorra
19Ankara
20Ankara
21Antananarivo
22Antananarivo
23Apia
24Apia
25Ashgabat
26Ashgabat
27Asmara
28Asmara
29Astana
30Astana
31Asuncion
32Asuncion
33Athens
34Athens
35Baghdad
36Baghdad
37Baku
38Baku
39Bamako
40Bamako
41Bandar Seri Begawan
42Bandar Seri Begawan
43Bangkok
44Bangkok
45Bangui
46Bangui
47Banjul
48Banjul
49Basseterre
50Basseterre
51Beijing
52Beijing
53Beirut
54Beirut
55Belgrade
56Belgrade
57Belmopan
58Belmopan
59Berlin
60Berlin
61Bern
62Bern
63Bishkek
64Bishkek
65Bissau
66Bissau
67Bloemfontein
68Bloemfontein
69Bogota
70Bogota
71Brasilia
72Brasilia
73Bratislava
74Bratislava
75Brazzaville
76Brazzaville
77Bridgetown
78Bridgetown
79Brussels
80Brussels
81Bucharest
82Bucharest
83Budapest
84Budapest
85Buenos Aires
86Buenos Aires
87Bujumbura
88Bujumbura
89Cairo
90Cairo
91Canberra
92Canberra
93Cape Town
94Cape Town
95Caracas
96Caracas
97Castries
98Castries
99Chisinau
100Chisinau
Rows: 1-100 | Columns: 2

Because we had copies of the same file, we can see that there are two records of each line. The ease of “*” allows us to ingest all the files in a particular folder.

Materialize#

When we do not materialize a table, it automatically becomes a flextable:

[3]:
data = vp.read_json(path = path + "laliga/*.json",
                    table_name = "laliga_verticapy_test_json",
                    schema = "complex_vmap_test",
                    ingest_local = False,
                    materialize = False,)
data
[3]:
123
referee.country.id
Integer
Abc
referee.country.name
Varchar(20)
123
stadium.country.id
Integer
123
referee.id
Integer
123
stadium.id
Integer
Abc
stadium.name
Varchar(64)
Abc
stadium.country.name
Varchar(26)
Abc
referee.name
Varchar(46)
Abc
Vmap(384)
Abc
Vmap(378)
123
metadata.xy_fidelity_version
Integer
📅
kick_off
Time
Abc
home_team.home_team_gender
Varchar(20)
123
home_team.country.id
Integer
Abc
competition.competition_name
Varchar(20)
Abc
away_team.away_team_name
Varchar(38)
Abc
away_team.away_team_gender
Varchar(20)
Abc
season.season_name
Varchar(20)
📅
metadata.data_version
Date
📅
match_date
Date
Abc
home_team.home_team_name
Varchar(40)
123
home_team.home_team_id
Integer
Abc
home_team.home_team_group
Varchar(20)
123
home_score
Integer
Abc
competition_stage.name
Varchar(28)
123
competition.competition_id
Integer
Abc
away_team.country.name
Varchar(20)
123
season.season_id
Integer
123
match_week
Integer
Abc
match_status
Varchar(20)
📅
last_updated
Timestamp
Abc
home_team.country.name
Varchar(20)
123
competition_stage.id
Integer
123
away_team.country.id
Integer
Abc
away_team.away_team_group
Varchar(20)
123
away_score
Integer
123
metadata.shot_fidelity_version
Integer
123
match_id
Integer
Abc
competition.country_name
Varchar(20)
123
away_team.away_team_id
Integer
1[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaGetafemale2004/20051.1.02005-04-17Barcelona217[null]2Regular Season11Spain3732available2019-12-16T23:09:16.168756Spain1214[null]0268352Spain216
2[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2004/20051.1.02004-10-16Espanyol214[null]0Regular Season11Spain377available2019-12-16T23:09:16.168756Spain1214[null]1268353Spain217
3[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaAlbacetemale2004/20051.1.02005-05-01Barcelona217[null]2Regular Season11Spain3734available2019-12-16T23:09:16.168756Spain1214[null]0268316Spain608
4[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaLevantemale2004/20051.1.02004-12-21Barcelona217[null]2Regular Season11Spain3717available2019-12-16T23:09:16.168756Spain1214[null]1268315Spain221
5[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaMálagamale2004/20051.1.02004-12-04Barcelona217[null]4Regular Season11Spain3714available2019-12-16T23:09:16.168756Spain1214[null]0268314Spain223
6[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaOsasunamale2004/20051.1.02004-10-24Barcelona217[null]3Regular Season11Spain378available2019-12-16T23:09:16.168756Spain1214[null]0268313Spain422
7[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaBarcelonamale2004/20051.1.02004-12-11Albacete608[null]1Regular Season11Spain3715available2019-12-16T23:09:16.168756Spain1214[null]2269153Spain217
8[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaRacing Santandermale2005/20061.1.02005-11-27Barcelona217[null]4Regular Season11Spain3813available2019-12-16T23:09:16.168756Spain1214[null]1268354Spain1217
9[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2005/20061.1.02006-02-25Real Zaragoza395[null]0Regular Season11Spain3825available2019-12-16T23:09:16.168756Spain1214[null]2268351Spain217
10[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaAtlético Madridmale2005/20061.1.02006-02-05Barcelona217[null]1Regular Season11Spain3822available2019-12-16T23:09:16.168756Spain1214[null]3268350Spain212
11[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaAthletic Bilbaomale2005/20061.1.02006-01-15Barcelona217[null]2Regular Season11Spain3819available2019-12-16T23:09:16.168756Spain1214[null]1268342Spain215
12[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaSevillamale2005/20061.1.02005-12-11Barcelona217[null]2Regular Season11Spain3815available2020-02-27T12:19:39.458017Spain1214[null]1268321Spain213
13[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2005/20061.1.02006-01-07Espanyol214[null]1Regular Season11Spain3818available2019-12-16T23:09:16.168756Spain1214[null]2268348Spain217
14[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaBarcelonamale2005/20061.1.02005-11-06Getafe216[null]1Regular Season11Spain3810available2019-12-16T23:09:16.168756Spain1214[null]3268339Spain217
15[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaBarcelonamale2005/20061.1.02005-11-19Real Madrid220[null]0Regular Season11Spain3812available2019-12-16T23:09:16.168756Spain1214[null]3268319Spain217
16[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaOsasunamale2005/20061.1.02005-10-22Barcelona217[null]3Regular Season11Spain388available2019-12-16T23:09:16.168756Spain1214[null]0268318Spain422
17[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaBarcelonamale2005/20061.1.02006-01-29Mallorca1043[null]0Regular Season11Spain3821available2019-12-16T23:09:16.168756Spain1214[null]3268325Spain217
18[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2005/20061.1.02005-12-17Cádiz552[null]1Regular Season11Spain3816available2019-12-16T23:09:16.168756Spain1214[null]3268322Spain217
19[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaReal Zaragozamale2005/20061.1.02005-10-01Barcelona217[null]2Regular Season11Spain386available2019-12-16T23:09:16.168756Spain1214[null]2268317Spain395
20[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaReal Betismale2005/20061.1.02006-02-18Barcelona217[null]5Regular Season11Spain3824available2019-12-16T23:09:16.168756Spain1214[null]1269172Spain218
21[null][null][null][null][null][null][null][null]220:30:00.000male214La LigaMálagamale2005/20061.1.02005-10-26Barcelona217[null]2Regular Season11Spain3811available2019-12-16T23:09:16.168756Spain1214[null]0269164Spain223
22[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaDeportivo Alavésmale2005/20061.1.02006-01-22Barcelona217[null]2Regular Season11Spain3820available2019-12-16T23:09:16.168756Spain1214[null]0268324Spain206
23[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaCelta Vigomale2005/20061.1.02005-12-20Barcelona217[null]2Regular Season11Spain3817available2019-12-16T23:09:16.168756Spain1214[null]0268323Spain209
24[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaBarcelonamale2005/20061.1.02005-12-04Villarreal222[null]0Regular Season11Spain3814available2019-12-16T23:09:16.168756Spain1214[null]2268320Spain217
25[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaRecreativo Huelvamale2007/20081.1.02007-11-24Barcelona217[null]3Regular Season11Spain4013available2019-12-16T23:09:16.168756Spain1214[null]0269184Spain1220
26[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaReal Zaragozamale2007/20081.1.02007-09-26Barcelona217[null]4Regular Season11Spain405available2019-12-16T23:09:16.168756Spain1214[null]1269143Spain395
27[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2007/20081.1.02008-05-17Real Murcia1230[null]3Regular Season11Spain4038available2019-12-16T23:09:16.168756Spain1214[null]5269186Spain217
28[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2007/20081.1.02008-02-16Real Zaragoza395[null]1Regular Season11Spain4024available2019-12-16T23:09:16.168756Spain1214[null]2269182Spain217
29[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaOsasunamale2007/20081.1.02008-02-03Barcelona217[null]1Regular Season11Spain4022available2019-12-16T23:09:16.168756Spain1214[null]0269187Spain422
30[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaBarcelonamale2007/20081.1.02008-01-27Athletic Bilbao215[null]1Regular Season11Spain4021available2019-12-16T23:09:16.168756Spain1214[null]1269181Spain217
31[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaBarcelonamale2007/20081.1.02007-11-10Getafe216[null]2Regular Season11Spain4012available2019-12-16T23:09:16.168756Spain1214[null]0269178Spain217
32[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaBarcelonamale2007/20081.1.02007-08-26Racing Santander1217[null]0Regular Season11Spain401available2019-12-16T23:09:16.168756Spain1214[null]0269180Spain217
33[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaRacing Santandermale2007/20081.1.02008-01-20Barcelona217[null]1Regular Season11Spain4020available2019-12-16T23:09:16.168756Spain1214[null]0269173Spain1217
34[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaSevillamale2007/20081.1.02007-09-22Barcelona217[null]2Regular Season11Spain404available2019-12-16T23:09:16.168756Spain1214[null]1269148Spain213
35[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaValenciamale2007/20081.1.02008-05-04Barcelona217[null]6Regular Season11Spain4035available2019-12-16T23:09:16.168756Spain1214[null]0269141Spain207
36[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2007/20081.1.02007-12-15Valencia207[null]0Regular Season11Spain4016available2019-12-16T23:09:16.168756Spain1214[null]3269145Spain217
37[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2007/20081.1.02008-05-07Real Madrid220[null]4Regular Season11Spain4036available2019-12-16T23:09:16.168756Spain1214[null]1268361Spain217
38[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaLevantemale2007/20081.1.02008-02-24Barcelona217[null]5Regular Season11Spain4025available2019-12-16T23:09:16.168756Spain1214[null]1268360Spain221
39[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaDeportivo La Corunamale2007/20081.1.02007-12-09Barcelona217[null]2Regular Season11Spain4015available2019-12-16T23:09:16.168756Spain1214[null]1269170Spain219
40[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaAthletic Bilbaomale2007/20081.1.02007-09-02Barcelona217[null]3Regular Season11Spain402available2019-12-16T23:09:16.168756Spain1214[null]1269169Spain215
41[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaReal Betismale2007/20081.1.02007-11-04Barcelona217[null]3Regular Season11Spain4011available2019-12-16T23:09:16.168756Spain1214[null]0269166Spain218
42[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaAlmeríamale2007/20081.1.02007-10-28Barcelona217[null]2Regular Season11Spain409available2019-12-16T23:09:16.168756Spain1214[null]0269158Spain403
43[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2007/20081.1.02007-09-29Levante221[null]1Regular Season11Spain406available2019-12-16T23:09:16.168756Spain1214[null]4269151Spain217
44[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2007/20081.1.02008-02-09Sevilla213[null]1Regular Season11Spain4023available2019-12-16T23:09:16.168756Spain1214[null]1269146Spain217
45[null][null][null][null][null][null][null][null]217:00:00.000male214La LigaAtlético Madridmale2007/20081.1.02007-10-07Barcelona217[null]3Regular Season11Spain407available2019-12-16T23:09:16.168756Spain1214[null]0269144Spain212
46[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaMallorcamale2007/20081.1.02008-05-11Barcelona217[null]2Regular Season11Spain4037available2019-12-16T23:09:16.168756Spain1214[null]3268366Spain1043
47[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaEspanyolmale2007/20081.1.02008-04-19Barcelona217[null]0Regular Season11Spain4033available2019-12-16T23:09:16.168756Spain1214[null]0268359Spain214
48[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2007/20081.1.02008-04-12Recreativo Huelva1220[null]2Regular Season11Spain4032available2019-12-16T23:09:16.168756Spain1214[null]2268358Spain217
49[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaBarcelonamale2007/20081.1.02008-03-01Atlético Madrid212[null]4Regular Season11Spain4026available2019-12-16T23:09:16.168756Spain1214[null]2268365Spain217
50[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2007/20081.1.02007-12-01Espanyol214[null]1Regular Season11Spain4014available2019-12-16T23:09:16.168756Spain1214[null]1268356Spain217
51[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2007/20081.1.02007-11-01Real Valladolid901[null]1Regular Season11Spain4010available2019-12-16T23:09:16.168756Spain1214[null]1268363Spain217
52[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaBarcelonamale2007/20081.1.02007-10-20Villarreal222[null]3Regular Season11Spain408available2019-12-16T23:09:16.168756Spain1214[null]1268364Spain217
53[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaBarcelonamale2008/20091.1.02008-11-16Recreativo Huelva1220[null]0Regular Season11Spain4111available2019-12-16T23:09:16.168756Spain1214[null]2269285Spain217
54[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaReal Valladolidmale2008/20091.1.02008-11-08Barcelona217[null]6Regular Season11Spain4110available2019-12-16T23:09:16.168756Spain1214[null]0269279Spain901
55[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2008/20091.1.02009-04-25Valencia207[null]2Regular Season11Spain4133available2019-12-16T23:09:16.168756Spain1214[null]2269251Spain217
56[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaBarcelonamale2008/20091.1.02009-05-02Real Madrid220[null]2Regular Season11Spain4134available2019-12-16T23:09:16.168756Spain1214[null]6269249Spain217
57[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaReal Betismale2008/20091.1.02008-09-24Barcelona217[null]3Regular Season11Spain414available2019-12-16T23:09:16.168756Spain1214[null]2269207Spain218
58[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaRacing Santandermale2008/20091.1.02008-09-13Barcelona217[null]1Regular Season11Spain412available2019-12-16T23:09:16.168756Spain1214[null]1269215Spain1217
59[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaBarcelonamale2008/20091.1.02009-02-14Real Betis218[null]2Regular Season11Spain4123available2019-12-16T23:09:16.168756Spain1214[null]2269195Spain217
60[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaNumanciamale2008/20091.1.02009-01-24Barcelona217[null]4Regular Season11Spain4120available2019-12-16T23:09:16.168756Spain1214[null]1269189Spain444
61[null][null][null][null][null][null][null][null]221:03:00.000male214La LigaBarcelonamale2008/20091.1.02009-03-15Almería403[null]0Regular Season11Spain4127available2019-12-16T23:09:16.168756Spain1214[null]2269177Spain217
62[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaBarcelonamale2008/20091.1.02009-03-01Atlético Madrid212[null]4Regular Season11Spain4125available2019-12-16T23:09:16.168756Spain1214[null]3269185Spain217
63[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaDeportivo La Corunamale2008/20091.1.02009-01-17Barcelona217[null]5Regular Season11Spain4119available2019-12-16T23:09:16.168756Spain1214[null]0269183Spain219
64[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2008/20091.1.02008-11-29Sevilla213[null]0Regular Season11Spain4113available2019-12-16T23:09:16.168756Spain1214[null]3269171Spain217
65[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaValenciamale2008/20091.1.02008-12-06Barcelona217[null]4Regular Season11Spain4114available2019-12-16T23:09:16.168756Spain1214[null]0269149Spain207
66[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaBarcelonamale2008/20091.1.02008-08-31Numancia444[null]1Regular Season11Spain411available2019-12-16T23:09:16.168756Spain1214[null]0269147Spain217
67[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaMálagamale2008/20091.1.02009-03-22Barcelona217[null]6Regular Season11Spain4128available2019-12-16T23:09:16.168756Spain1214[null]0269142Spain223
68[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaEspanyolmale2008/20091.1.02009-02-21Barcelona217[null]1Regular Season11Spain4124available2019-12-16T23:09:16.168756Spain1214[null]2269139Spain214
69[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaBarcelonamale2008/20091.1.02008-09-21Sporting Gijón1041[null]1Regular Season11Spain413available2019-12-16T23:09:16.168756Spain1214[null]6269138Spain217
70[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaBarcelonamale2008/20091.1.02008-12-21Villarreal222[null]1Regular Season11Spain4116available2019-12-16T23:09:16.168756Spain1214[null]2269228Spain217
71[null][null][null][null][null][null][null][null]219:03:00.000male214La LigaVillarrealmale2008/20091.1.02009-05-10Barcelona217[null]3Regular Season11Spain4135available2019-12-16T23:09:16.168756Spain1214[null]3269217Spain222
72[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaBarcelonamale2008/20091.1.02009-04-18Getafe216[null]0Regular Season11Spain4131available2019-12-16T23:09:16.168756Spain1214[null]1269223Spain217
73[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaRecreativo Huelvamale2008/20091.1.02009-04-11Barcelona217[null]2Regular Season11Spain4130available2019-12-16T23:09:16.168756Spain1214[null]0269222Spain1220
74[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaBarcelonamale2008/20091.1.02009-04-04Real Valladolid901[null]0Regular Season11Spain4129available2019-12-16T23:09:16.168756Spain1214[null]1269273Spain217
75[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaAthletic Bilbaomale2008/20091.1.02009-03-07Barcelona217[null]2Regular Season11Spain4126available2019-12-16T23:09:16.168756Spain1214[null]0269216Spain215
76[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaSporting Gijónmale2008/20091.1.02009-02-08Barcelona217[null]3Regular Season11Spain4122available2019-12-16T23:09:16.168756Spain1214[null]1269231Spain1041
77[null][null][null][null][null][null][null][null]217:00:00.000male214La LigaBarcelonamale2008/20091.1.02009-02-01Racing Santander1217[null]1Regular Season11Spain4121available2019-12-16T23:09:16.168756Spain1214[null]2269209Spain217
78[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaBarcelonamale2008/20091.1.02009-01-11Osasuna422[null]2Regular Season11Spain4118available2019-12-16T23:09:16.168756Spain1214[null]3269230Spain217
79[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaReal Madridmale2008/20091.1.02008-12-13Barcelona217[null]2Regular Season11Spain4115available2019-12-16T23:09:16.168756Spain1214[null]0269225Spain220
80[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaBarcelonamale2008/20091.1.02008-11-01Málaga223[null]1Regular Season11Spain419available2019-12-16T23:09:16.168756Spain1214[null]4269235Spain217
81[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaAlmeríamale2008/20091.1.02008-10-25Barcelona217[null]5Regular Season11Spain418available2019-12-16T23:09:16.168756Spain1214[null]0269232Spain403
82[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaAtlético Madridmale2008/20091.1.02008-10-04Barcelona217[null]6Regular Season11Spain416available2019-12-16T23:09:16.168756Spain1214[null]1269212Spain212
83[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2008/20091.1.02008-09-27Espanyol214[null]1Regular Season11Spain415available2019-12-16T23:09:16.168756Spain1214[null]2269211Spain217
84[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2010/20111.1.02011-04-16Real Madrid220[null]1Regular Season11Spain2232available2020-04-09T13:13:49.345111Spain1214[null]1269245Spain217
85[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaGetafemale2010/20111.1.02011-03-19Barcelona217[null]2Regular Season11Spain2229available2019-12-16T23:09:16.168756Spain1214[null]1269303Spain216
86[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaReal Sociedadmale2010/20111.1.02010-12-12Barcelona217[null]5Regular Season11Spain2215available2019-12-16T23:09:16.168756Spain1214[null]0269302Spain210
87[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaBarcelonamale2010/20111.1.02010-11-20Almería403[null]0Regular Season11Spain2212available2019-12-16T23:09:16.168756Spain1214[null]8269306Spain217
88[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaVillarrealmale2010/20111.1.02010-11-13Barcelona217[null]3Regular Season11Spain2211available2019-12-16T23:09:16.168756Spain1214[null]1269308Spain222
89[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaReal Madridmale2010/20111.1.02010-11-29Barcelona217[null]5Regular Season11Spain2213available2019-12-16T23:09:16.168756Spain1214[null]0269299Spain220
90[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaReal Zaragozamale2010/20111.1.02011-03-05Barcelona217[null]1Regular Season11Spain2227available2019-12-16T23:09:16.168756Spain1214[null]0269300Spain395
91[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaRacing Santandermale2010/20111.1.02011-01-22Barcelona217[null]3Regular Season11Spain2220available2019-12-16T23:09:16.168756Spain1214[null]0269295Spain1217
92[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaBarcelonamale2010/20111.1.02011-01-29Hércules1218[null]0Regular Season11Spain2221available2019-12-16T23:09:16.168756Spain1214[null]3269296Spain217
93[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaBarcelonamale2010/20111.1.02011-03-13Sevilla213[null]1Regular Season11Spain2228available2019-12-16T23:09:16.168756Spain1214[null]1269291Spain217
94[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaSevillamale2010/20111.1.02010-10-30Barcelona217[null]5Regular Season11Spain229available2019-12-16T23:09:16.168756Spain1214[null]0269289Spain213
95[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaBarcelonamale2010/20111.1.02010-08-29Racing Santander1217[null]0Regular Season11Spain221available2019-12-16T23:09:16.168756Spain1214[null]3269286Spain217
96[null][null][null][null][null][null][null][null]218:00:00.000male214La LigaHérculesmale2010/20111.1.02010-09-11Barcelona217[null]0Regular Season11Spain222available2019-12-16T23:09:16.168756Spain1214[null]2269287Spain1218
97[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2010/20111.1.02011-03-02Valencia207[null]0Regular Season11Spain2226available2019-12-16T23:09:16.168756Spain1214[null]1269274Spain217
98[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaBarcelonamale2010/20111.1.02011-02-26Mallorca1043[null]0Regular Season11Spain2225available2019-12-16T23:09:16.168756Spain1214[null]3269283Spain217
99[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaAthletic Bilbaomale2010/20111.1.02011-02-20Barcelona217[null]2Regular Season11Spain2224available2019-12-16T23:09:16.168756Spain1214[null]1269282Spain215
100[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaMálagamale2010/20111.1.02011-01-16Barcelona217[null]4Regular Season11Spain2219available2019-12-16T23:09:16.168756Spain1214[null]1269278Spain223
Rows: 1-100 | Columns: 40

Some of the columns are VMAPs:

[11]:
managers = ["away_team.managers", "home_team.managers"]
for m in managers:
    print(data[m].isvmap())
True
True

We can easily flatten the VMaps virtual columns by using the vDataFrame.flat_vmap method:

[5]:
data.flat_vmap(managers).drop(managers)
[5]:
Abc
referee.country.id
Long varchar(130000)
Abc
referee.country.name
Long varchar(130000)
Abc
stadium.country.id
Long varchar(130000)
Abc
referee.id
Long varchar(130000)
Abc
stadium.id
Long varchar(130000)
Abc
stadium.name
Long varchar(130000)
Abc
stadium.country.name
Long varchar(130000)
Abc
referee.name
Long varchar(130000)
Abc
metadata.xy_fidelity_version
Long varchar(130000)
Abc
kick_off
Long varchar(130000)
Abc
home_team.home_team_gender
Long varchar(130000)
Abc
home_team.country.id
Long varchar(130000)
Abc
competition.competition_name
Long varchar(130000)
Abc
away_team.away_team_name
Long varchar(130000)
Abc
away_team.away_team_gender
Long varchar(130000)
Abc
season.season_name
Long varchar(130000)
Abc
metadata.data_version
Long varchar(130000)
Abc
match_date
Long varchar(130000)
Abc
home_team.home_team_name
Long varchar(130000)
Abc
home_team.home_team_id
Long varchar(130000)
Abc
home_team.home_team_group
Long varchar(130000)
Abc
home_score
Long varchar(130000)
Abc
competition_stage.name
Long varchar(130000)
Abc
competition.competition_id
Long varchar(130000)
Abc
away_team.country.name
Long varchar(130000)
...
Abc
season.season_id
Long varchar(130000)
Abc
match_week
Long varchar(130000)
Abc
match_status
Long varchar(130000)
Abc
last_updated
Long varchar(130000)
Abc
home_team.country.name
Long varchar(130000)
Abc
competition_stage.id
Long varchar(130000)
Abc
away_team.country.id
Long varchar(130000)
Abc
away_team.away_team_group
Long varchar(130000)
Abc
away_score
Long varchar(130000)
Abc
metadata.shot_fidelity_version
Long varchar(130000)
Abc
match_id
Long varchar(130000)
Abc
competition.country_name
Long varchar(130000)
Abc
away_team.away_team_id
Long varchar(130000)
Abc
Long varchar(130000)
Abc
away_team.managers.0.id
Long varchar(130000)
Abc
Long varchar(130000)
Abc
away_team.managers.0.nickname
Long varchar(130000)
Abc
away_team.managers.0.dob
Long varchar(130000)
Abc
away_team.managers.0.country.id
Long varchar(130000)
Abc
home_team.managers.0.id
Long varchar(130000)
Abc
Long varchar(130000)
Abc
Long varchar(130000)
Abc
home_team.managers.0.nickname
Long varchar(130000)
Abc
home_team.managers.0.dob
Long varchar(130000)
Abc
home_team.managers.0.country.id
Long varchar(130000)
1[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaGetafemale2004/20051.1.02005-04-17Barcelona217[null]2Regular Season11Spain...3732available2019-12-16T23:09:16.168756Spain1214[null]0268352Spain216[null][null][null][null][null][null][null][null]
2[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2004/20051.1.02004-10-16Espanyol214[null]0Regular Season11Spain...377available2019-12-16T23:09:16.168756Spain1214[null]1268353Spain217[null][null][null][null][null][null][null][null]
3[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaAlbacetemale2004/20051.1.02005-05-01Barcelona217[null]2Regular Season11Spain...3734available2019-12-16T23:09:16.168756Spain1214[null]0268316Spain608[null][null][null][null][null][null][null][null]
4[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaLevantemale2004/20051.1.02004-12-21Barcelona217[null]2Regular Season11Spain...3717available2019-12-16T23:09:16.168756Spain1214[null]1268315Spain221[null][null][null][null][null][null][null][null]
5[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaMálagamale2004/20051.1.02004-12-04Barcelona217[null]4Regular Season11Spain...3714available2019-12-16T23:09:16.168756Spain1214[null]0268314Spain223[null][null][null][null][null][null][null][null]
6[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaOsasunamale2004/20051.1.02004-10-24Barcelona217[null]3Regular Season11Spain...378available2019-12-16T23:09:16.168756Spain1214[null]0268313Spain422[null][null][null][null][null][null][null][null]
7[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaBarcelonamale2004/20051.1.02004-12-11Albacete608[null]1Regular Season11Spain...3715available2019-12-16T23:09:16.168756Spain1214[null]2269153Spain217[null][null][null][null][null][null][null][null]
8[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaRacing Santandermale2005/20061.1.02005-11-27Barcelona217[null]4Regular Season11Spain...3813available2019-12-16T23:09:16.168756Spain1214[null]1268354Spain1217[null][null][null][null][null][null][null][null]
9[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2005/20061.1.02006-02-25Real Zaragoza395[null]0Regular Season11Spain...3825available2019-12-16T23:09:16.168756Spain1214[null]2268351Spain217[null][null][null][null][null][null][null][null]
10[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaAtlético Madridmale2005/20061.1.02006-02-05Barcelona217[null]1Regular Season11Spain...3822available2019-12-16T23:09:16.168756Spain1214[null]3268350Spain212[null][null][null][null][null][null][null][null]
11[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaAthletic Bilbaomale2005/20061.1.02006-01-15Barcelona217[null]2Regular Season11Spain...3819available2019-12-16T23:09:16.168756Spain1214[null]1268342Spain215[null][null][null][null][null][null][null][null]
12[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaSevillamale2005/20061.1.02005-12-11Barcelona217[null]2Regular Season11Spain...3815available2020-02-27T12:19:39.458017Spain1214[null]1268321Spain213[null][null][null][null][null][null][null][null]
13[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2005/20061.1.02006-01-07Espanyol214[null]1Regular Season11Spain...3818available2019-12-16T23:09:16.168756Spain1214[null]2268348Spain217[null][null][null][null][null][null][null][null]
14[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaBarcelonamale2005/20061.1.02005-11-06Getafe216[null]1Regular Season11Spain...3810available2019-12-16T23:09:16.168756Spain1214[null]3268339Spain217[null][null][null][null][null][null][null][null]
15[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaBarcelonamale2005/20061.1.02005-11-19Real Madrid220[null]0Regular Season11Spain...3812available2019-12-16T23:09:16.168756Spain1214[null]3268319Spain217[null][null][null][null][null][null][null][null]
16[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaOsasunamale2005/20061.1.02005-10-22Barcelona217[null]3Regular Season11Spain...388available2019-12-16T23:09:16.168756Spain1214[null]0268318Spain422[null][null][null][null][null][null][null][null]
17[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaBarcelonamale2005/20061.1.02006-01-29Mallorca1043[null]0Regular Season11Spain...3821available2019-12-16T23:09:16.168756Spain1214[null]3268325Spain217[null][null][null][null][null][null][null][null]
18[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2005/20061.1.02005-12-17Cádiz552[null]1Regular Season11Spain...3816available2019-12-16T23:09:16.168756Spain1214[null]3268322Spain217[null][null][null][null][null][null][null][null]
19[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaReal Zaragozamale2005/20061.1.02005-10-01Barcelona217[null]2Regular Season11Spain...386available2019-12-16T23:09:16.168756Spain1214[null]2268317Spain395[null][null][null][null][null][null][null][null]
20[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaReal Betismale2005/20061.1.02006-02-18Barcelona217[null]5Regular Season11Spain...3824available2019-12-16T23:09:16.168756Spain1214[null]1269172Spain218[null][null][null][null][null][null][null][null]
21[null][null][null][null][null][null][null][null]220:30:00.000male214La LigaMálagamale2005/20061.1.02005-10-26Barcelona217[null]2Regular Season11Spain...3811available2019-12-16T23:09:16.168756Spain1214[null]0269164Spain223[null][null][null][null][null][null][null][null]
22[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaDeportivo Alavésmale2005/20061.1.02006-01-22Barcelona217[null]2Regular Season11Spain...3820available2019-12-16T23:09:16.168756Spain1214[null]0268324Spain206[null][null][null][null][null][null][null][null]
23[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaCelta Vigomale2005/20061.1.02005-12-20Barcelona217[null]2Regular Season11Spain...3817available2019-12-16T23:09:16.168756Spain1214[null]0268323Spain209[null][null][null][null][null][null][null][null]
24[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaBarcelonamale2005/20061.1.02005-12-04Villarreal222[null]0Regular Season11Spain...3814available2019-12-16T23:09:16.168756Spain1214[null]2268320Spain217[null][null][null][null][null][null][null][null]
25[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaRecreativo Huelvamale2007/20081.1.02007-11-24Barcelona217[null]3Regular Season11Spain...4013available2019-12-16T23:09:16.168756Spain1214[null]0269184Spain1220[null][null][null][null][null][null][null][null]
26[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaReal Zaragozamale2007/20081.1.02007-09-26Barcelona217[null]4Regular Season11Spain...405available2019-12-16T23:09:16.168756Spain1214[null]1269143Spain395[null][null][null][null][null][null][null][null]
27[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2007/20081.1.02008-05-17Real Murcia1230[null]3Regular Season11Spain...4038available2019-12-16T23:09:16.168756Spain1214[null]5269186Spain217[null][null][null][null][null][null][null][null]
28[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2007/20081.1.02008-02-16Real Zaragoza395[null]1Regular Season11Spain...4024available2019-12-16T23:09:16.168756Spain1214[null]2269182Spain217[null][null][null][null][null][null][null][null]
29[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaOsasunamale2007/20081.1.02008-02-03Barcelona217[null]1Regular Season11Spain...4022available2019-12-16T23:09:16.168756Spain1214[null]0269187Spain422[null][null][null][null][null][null][null][null]
30[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaBarcelonamale2007/20081.1.02008-01-27Athletic Bilbao215[null]1Regular Season11Spain...4021available2019-12-16T23:09:16.168756Spain1214[null]1269181Spain217[null][null][null][null][null][null][null][null]
31[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaBarcelonamale2007/20081.1.02007-11-10Getafe216[null]2Regular Season11Spain...4012available2019-12-16T23:09:16.168756Spain1214[null]0269178Spain217[null][null][null][null][null][null][null][null]
32[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaBarcelonamale2007/20081.1.02007-08-26Racing Santander1217[null]0Regular Season11Spain...401available2019-12-16T23:09:16.168756Spain1214[null]0269180Spain217[null][null][null][null][null][null][null][null]
33[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaRacing Santandermale2007/20081.1.02008-01-20Barcelona217[null]1Regular Season11Spain...4020available2019-12-16T23:09:16.168756Spain1214[null]0269173Spain1217[null][null][null][null][null][null][null][null]
34[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaSevillamale2007/20081.1.02007-09-22Barcelona217[null]2Regular Season11Spain...404available2019-12-16T23:09:16.168756Spain1214[null]1269148Spain213[null][null][null][null][null][null][null][null]
35[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaValenciamale2007/20081.1.02008-05-04Barcelona217[null]6Regular Season11Spain...4035available2019-12-16T23:09:16.168756Spain1214[null]0269141Spain207[null][null][null][null][null][null][null][null]
36[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2007/20081.1.02007-12-15Valencia207[null]0Regular Season11Spain...4016available2019-12-16T23:09:16.168756Spain1214[null]3269145Spain217[null][null][null][null][null][null][null][null]
37[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2007/20081.1.02008-05-07Real Madrid220[null]4Regular Season11Spain...4036available2019-12-16T23:09:16.168756Spain1214[null]1268361Spain217[null][null][null][null][null][null][null][null]
38[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaLevantemale2007/20081.1.02008-02-24Barcelona217[null]5Regular Season11Spain...4025available2019-12-16T23:09:16.168756Spain1214[null]1268360Spain221[null][null][null][null][null][null][null][null]
39[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaDeportivo La Corunamale2007/20081.1.02007-12-09Barcelona217[null]2Regular Season11Spain...4015available2019-12-16T23:09:16.168756Spain1214[null]1269170Spain219[null][null][null][null][null][null][null][null]
40[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaAthletic Bilbaomale2007/20081.1.02007-09-02Barcelona217[null]3Regular Season11Spain...402available2019-12-16T23:09:16.168756Spain1214[null]1269169Spain215[null][null][null][null][null][null][null][null]
41[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaReal Betismale2007/20081.1.02007-11-04Barcelona217[null]3Regular Season11Spain...4011available2019-12-16T23:09:16.168756Spain1214[null]0269166Spain218[null][null][null][null][null][null][null][null]
42[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaAlmeríamale2007/20081.1.02007-10-28Barcelona217[null]2Regular Season11Spain...409available2019-12-16T23:09:16.168756Spain1214[null]0269158Spain403[null][null][null][null][null][null][null][null]
43[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2007/20081.1.02007-09-29Levante221[null]1Regular Season11Spain...406available2019-12-16T23:09:16.168756Spain1214[null]4269151Spain217[null][null][null][null][null][null][null][null]
44[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2007/20081.1.02008-02-09Sevilla213[null]1Regular Season11Spain...4023available2019-12-16T23:09:16.168756Spain1214[null]1269146Spain217[null][null][null][null][null][null][null][null]
45[null][null][null][null][null][null][null][null]217:00:00.000male214La LigaAtlético Madridmale2007/20081.1.02007-10-07Barcelona217[null]3Regular Season11Spain...407available2019-12-16T23:09:16.168756Spain1214[null]0269144Spain212[null][null][null][null][null][null][null][null]
46[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaMallorcamale2007/20081.1.02008-05-11Barcelona217[null]2Regular Season11Spain...4037available2019-12-16T23:09:16.168756Spain1214[null]3268366Spain1043[null][null][null][null][null][null][null][null]
47[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaEspanyolmale2007/20081.1.02008-04-19Barcelona217[null]0Regular Season11Spain...4033available2019-12-16T23:09:16.168756Spain1214[null]0268359Spain214[null][null][null][null][null][null][null][null]
48[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2007/20081.1.02008-04-12Recreativo Huelva1220[null]2Regular Season11Spain...4032available2019-12-16T23:09:16.168756Spain1214[null]2268358Spain217[null][null][null][null][null][null][null][null]
49[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaBarcelonamale2007/20081.1.02008-03-01Atlético Madrid212[null]4Regular Season11Spain...4026available2019-12-16T23:09:16.168756Spain1214[null]2268365Spain217[null][null][null][null][null][null][null][null]
50[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2007/20081.1.02007-12-01Espanyol214[null]1Regular Season11Spain...4014available2019-12-16T23:09:16.168756Spain1214[null]1268356Spain217[null][null][null][null][null][null][null][null]
51[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2007/20081.1.02007-11-01Real Valladolid901[null]1Regular Season11Spain...4010available2019-12-16T23:09:16.168756Spain1214[null]1268363Spain217[null][null][null][null][null][null][null][null]
52[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaBarcelonamale2007/20081.1.02007-10-20Villarreal222[null]3Regular Season11Spain...408available2019-12-16T23:09:16.168756Spain1214[null]1268364Spain217[null][null][null][null][null][null][null][null]
53[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaBarcelonamale2008/20091.1.02008-11-16Recreativo Huelva1220[null]0Regular Season11Spain...4111available2019-12-16T23:09:16.168756Spain1214[null]2269285Spain21736Pep Guardiola[null]2141612Lucas Alcaraz[null]214
54[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaReal Valladolidmale2008/20091.1.02008-11-08Barcelona217[null]6Regular Season11Spain...4110available2019-12-16T23:09:16.168756Spain1214[null]0269279Spain901221José Luis Mendilibar[null]21436Pep Guardiola[null]214
55[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2008/20091.1.02009-04-25Valencia207[null]2Regular Season11Spain...4133available2019-12-16T23:09:16.168756Spain1214[null]2269251Spain21736Pep Guardiola[null]21421Unai Emery[null]214
56[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaBarcelonamale2008/20091.1.02009-05-02Real Madrid220[null]2Regular Season11Spain...4134available2019-12-16T23:09:16.168756Spain1214[null]6269249Spain21736Pep Guardiola[null]2143899Juande Ramos[null]214
57[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaReal Betismale2008/20091.1.02008-09-24Barcelona217[null]3Regular Season11Spain...414available2019-12-16T23:09:16.168756Spain1214[null]2269207Spain218[null][null][null][null][null][null][null][null]
58[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaRacing Santandermale2008/20091.1.02008-09-13Barcelona217[null]1Regular Season11Spain...412available2019-12-16T23:09:16.168756Spain1214[null]1269215Spain12172Juan Muñiz1968-11-0221436Pep Guardiola[null]214
59[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaBarcelonamale2008/20091.1.02009-02-14Real Betis218[null]2Regular Season11Spain...4123available2019-12-16T23:09:16.168756Spain1214[null]2269195Spain217[null][null][null][null][null][null][null][null]
60[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaNumanciamale2008/20091.1.02009-01-24Barcelona217[null]4Regular Season11Spain...4120available2019-12-16T23:09:16.168756Spain1214[null]1269189Spain444[null][null][null][null][null][null][null][null]
61[null][null][null][null][null][null][null][null]221:03:00.000male214La LigaBarcelonamale2008/20091.1.02009-03-15Almería403[null]0Regular Season11Spain...4127available2019-12-16T23:09:16.168756Spain1214[null]2269177Spain217[null][null][null][null][null][null][null][null]
62[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaBarcelonamale2008/20091.1.02009-03-01Atlético Madrid212[null]4Regular Season11Spain...4125available2019-12-16T23:09:16.168756Spain1214[null]3269185Spain217[null][null][null][null][null][null][null][null]
63[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaDeportivo La Corunamale2008/20091.1.02009-01-17Barcelona217[null]5Regular Season11Spain...4119available2019-12-16T23:09:16.168756Spain1214[null]0269183Spain2194519Miguel Ángel Lotina[null]21436Pep Guardiola[null]214
64[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2008/20091.1.02008-11-29Sevilla213[null]0Regular Season11Spain...4113available2019-12-16T23:09:16.168756Spain1214[null]3269171Spain21736Pep Guardiola[null]2141621Manolo Jiménez1964-01-26214
65[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaValenciamale2008/20091.1.02008-12-06Barcelona217[null]4Regular Season11Spain...4114available2019-12-16T23:09:16.168756Spain1214[null]0269149Spain20721Unai Emery[null]21436Pep Guardiola[null]214
66[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaBarcelonamale2008/20091.1.02008-08-31Numancia444[null]1Regular Season11Spain...411available2019-12-16T23:09:16.168756Spain1214[null]0269147Spain217[null][null][null][null][null][null][null][null]
67[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaMálagamale2008/20091.1.02009-03-22Barcelona217[null]6Regular Season11Spain...4128available2019-12-16T23:09:16.168756Spain1214[null]0269142Spain223[null][null][null][null][null][null][null][null]
68[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaEspanyolmale2008/20091.1.02009-02-21Barcelona217[null]1Regular Season11Spain...4124available2019-12-16T23:09:16.168756Spain1214[null]2269139Spain21481Mauricio Pochettino[null]1136Pep Guardiola[null]214
69[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaBarcelonamale2008/20091.1.02008-09-21Sporting Gijón1041[null]1Regular Season11Spain...413available2019-12-16T23:09:16.168756Spain1214[null]6269138Spain217[null][null][null][null][null][null][null][null]
70[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaBarcelonamale2008/20091.1.02008-12-21Villarreal222[null]1Regular Season11Spain...4116available2019-12-16T23:09:16.168756Spain1214[null]2269228Spain21736Pep Guardiola[null]214733Manuel Pellegrini[null]45
71[null][null][null][null][null][null][null][null]219:03:00.000male214La LigaVillarrealmale2008/20091.1.02009-05-10Barcelona217[null]3Regular Season11Spain...4135available2019-12-16T23:09:16.168756Spain1214[null]3269217Spain222733Manuel Pellegrini[null]4536Pep Guardiola[null]214
72[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaBarcelonamale2008/20091.1.02009-04-18Getafe216[null]0Regular Season11Spain...4131available2019-12-16T23:09:16.168756Spain1214[null]1269223Spain217[null][null][null][null][null][null][null][null]
73[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaRecreativo Huelvamale2008/20091.1.02009-04-11Barcelona217[null]2Regular Season11Spain...4130available2019-12-16T23:09:16.168756Spain1214[null]0269222Spain12201612Lucas Alcaraz[null]21436Pep Guardiola[null]214
74[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaBarcelonamale2008/20091.1.02009-04-04Real Valladolid901[null]0Regular Season11Spain...4129available2019-12-16T23:09:16.168756Spain1214[null]1269273Spain21736Pep Guardiola[null]214221José Luis Mendilibar[null]214
75[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaAthletic Bilbaomale2008/20091.1.02009-03-07Barcelona217[null]2Regular Season11Spain...4126available2019-12-16T23:09:16.168756Spain1214[null]0269216Spain215497Joaquín Caparrós1955-10-1321436Pep Guardiola[null]214
76[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaSporting Gijónmale2008/20091.1.02009-02-08Barcelona217[null]3Regular Season11Spain...4122available2019-12-16T23:09:16.168756Spain1214[null]1269231Spain1041[null][null][null][null][null][null][null][null]
77[null][null][null][null][null][null][null][null]217:00:00.000male214La LigaBarcelonamale2008/20091.1.02009-02-01Racing Santander1217[null]1Regular Season11Spain...4121available2019-12-16T23:09:16.168756Spain1214[null]2269209Spain21736Pep Guardiola[null]2142Juan Muñiz1968-11-02214
78[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaBarcelonamale2008/20091.1.02009-01-11Osasuna422[null]2Regular Season11Spain...4118available2019-12-16T23:09:16.168756Spain1214[null]3269230Spain217[null][null][null][null][null][null][null][null]
79[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaReal Madridmale2008/20091.1.02008-12-13Barcelona217[null]2Regular Season11Spain...4115available2019-12-16T23:09:16.168756Spain1214[null]0269225Spain2203899Juande Ramos[null]21436Pep Guardiola[null]214
80[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaBarcelonamale2008/20091.1.02008-11-01Málaga223[null]1Regular Season11Spain...419available2019-12-16T23:09:16.168756Spain1214[null]4269235Spain217[null][null][null][null][null][null][null][null]
81[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaAlmeríamale2008/20091.1.02008-10-25Barcelona217[null]5Regular Season11Spain...418available2019-12-16T23:09:16.168756Spain1214[null]0269232Spain403[null][null][null][null][null][null][null][null]
82[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaAtlético Madridmale2008/20091.1.02008-10-04Barcelona217[null]6Regular Season11Spain...416available2019-12-16T23:09:16.168756Spain1214[null]1269212Spain2123196Javier Aguirre[null]14736Pep Guardiola[null]214
83[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2008/20091.1.02008-09-27Espanyol214[null]1Regular Season11Spain...415available2019-12-16T23:09:16.168756Spain1214[null]2269211Spain217[null][null][null][null][null][null][null][null]
84[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2010/20111.1.02011-04-16Real Madrid220[null]1Regular Season11Spain...2232available2020-04-09T13:13:49.345111Spain1214[null]1269245Spain21736Pep Guardiola[null]214383José Mourinho[null]183
85[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaGetafemale2010/20111.1.02011-03-19Barcelona217[null]2Regular Season11Spain...2229available2019-12-16T23:09:16.168756Spain1214[null]1269303Spain216505Míchel[null]21436Pep Guardiola[null]214
86[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaReal Sociedadmale2010/20111.1.02010-12-12Barcelona217[null]5Regular Season11Spain...2215available2019-12-16T23:09:16.168756Spain1214[null]0269302Spain210[null][null][null][null][null][null][null][null]
87[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaBarcelonamale2010/20111.1.02010-11-20Almería403[null]0Regular Season11Spain...2212available2019-12-16T23:09:16.168756Spain1214[null]8269306Spain217[null][null][null][null][null][null][null][null]
88[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaVillarrealmale2010/20111.1.02010-11-13Barcelona217[null]3Regular Season11Spain...2211available2019-12-16T23:09:16.168756Spain1214[null]1269308Spain2224201Juan Garrido[null]21436Pep Guardiola[null]214
89[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaReal Madridmale2010/20111.1.02010-11-29Barcelona217[null]5Regular Season11Spain...2213available2019-12-16T23:09:16.168756Spain1214[null]0269299Spain220383José Mourinho[null]18336Pep Guardiola[null]214
90[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaReal Zaragozamale2010/20111.1.02011-03-05Barcelona217[null]1Regular Season11Spain...2227available2019-12-16T23:09:16.168756Spain1214[null]0269300Spain3953196Javier Aguirre[null]14736Pep Guardiola[null]214
91[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaRacing Santandermale2010/20111.1.02011-01-22Barcelona217[null]3Regular Season11Spain...2220available2019-12-16T23:09:16.168756Spain1214[null]0269295Spain1217[null][null][null][null][null][null][null][null]
92[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaBarcelonamale2010/20111.1.02011-01-29Hércules1218[null]0Regular Season11Spain...2221available2019-12-16T23:09:16.168756Spain1214[null]3269296Spain217[null][null][null][null][null][null][null][null]
93[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaBarcelonamale2010/20111.1.02011-03-13Sevilla213[null]1Regular Season11Spain...2228available2019-12-16T23:09:16.168756Spain1214[null]1269291Spain217[null][null][null][null][null][null][null][null]
94[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaSevillamale2010/20111.1.02010-10-30Barcelona217[null]5Regular Season11Spain...229available2019-12-16T23:09:16.168756Spain1214[null]0269289Spain213[null][null][null][null][null][null][null][null]
95[null][null][null][null][null][null][null][null]219:00:00.000male214La LigaBarcelonamale2010/20111.1.02010-08-29Racing Santander1217[null]0Regular Season11Spain...221available2019-12-16T23:09:16.168756Spain1214[null]3269286Spain217[null][null][null][null][null][null][null][null]
96[null][null][null][null][null][null][null][null]218:00:00.000male214La LigaHérculesmale2010/20111.1.02010-09-11Barcelona217[null]0Regular Season11Spain...222available2019-12-16T23:09:16.168756Spain1214[null]2269287Spain1218[null][null][null][null][null][null][null][null]
97[null][null][null][null][null][null][null][null]222:00:00.000male214La LigaBarcelonamale2010/20111.1.02011-03-02Valencia207[null]0Regular Season11Spain...2226available2019-12-16T23:09:16.168756Spain1214[null]1269274Spain21736Pep Guardiola[null]21421Unai Emery[null]214
98[null][null][null][null][null][null][null][null]220:00:00.000male214La LigaBarcelonamale2010/20111.1.02011-02-26Mallorca1043[null]0Regular Season11Spain...2225available2019-12-16T23:09:16.168756Spain1214[null]3269283Spain217[null][null][null][null][null][null][null][null]
99[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaAthletic Bilbaomale2010/20111.1.02011-02-20Barcelona217[null]2Regular Season11Spain...2224available2019-12-16T23:09:16.168756Spain1214[null]1269282Spain215497Joaquín Caparrós1955-10-1321436Pep Guardiola[null]214
100[null][null][null][null][null][null][null][null]221:00:00.000male214La LigaMálagamale2010/20111.1.02011-01-16Barcelona217[null]4Regular Season11Spain...2219available2019-12-16T23:09:16.168756Spain1214[null]1269278Spain223733Manuel Pellegrini[null]4536Pep Guardiola[null]214
Rows: 1-100 | Columns: 50

To check for a flex table, we can use the following function:

[46]:
isflextable(table_name = "laliga_verticapy_test_json", schema = "complex_vmap_test")
[46]:
True

We can then manually materialize the flextable using the convenient vDataFrame.to_db method:

[47]:
data.to_db("complex_vmap_test.laliga_to_db")
[47]:
Abc
season.season_name
Varchar(20)
123
season.season_id
Integer
123
metadata.xy_fidelity_version
Integer
123
metadata.shot_fidelity_version
Integer
📅
metadata.data_version
Date
123
match_week
Integer
Abc
match_status
Varchar(20)
123
match_id
Integer
📅
match_date
Date
📅
last_updated
Timestamp
📅
kick_off
Time
Abc
home_team.home_team_name
Varchar(26)
123
home_team.home_team_id
Integer
Abc
home_team.home_team_group
Varchar(20)
Abc
home_team.home_team_gender
Varchar(20)
Abc
home_team.country.name
Varchar(20)
123
home_team.country.id
Integer
123
home_score
Integer
Abc
competition_stage.name
Varchar(28)
123
competition_stage.id
Integer
Abc
competition.country_name
Varchar(20)
Abc
competition.competition_name
Varchar(20)
123
competition.competition_id
Integer
Abc
away_team.country.name
Varchar(20)
123
away_team.country.id
Integer
Abc
away_team.away_team_name
Varchar(34)
123
away_team.away_team_id
Integer
Abc
away_team.away_team_group
Varchar(20)
Abc
away_team.away_team_gender
Varchar(20)
123
away_score
Integer
12005/200638221.1.013available683542005-11-272019-12-16T23:09:16.16875621:00:00.000Barcelona217[null]maleSpain2144Regular Season1SpainLa Liga11Spain214Racing Santander1217[null]male1
22005/200638221.1.025available683512006-02-252019-12-16T23:09:16.16875622:00:00.000Real Zaragoza395[null]maleSpain2140Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
32005/200638221.1.022available683502006-02-052019-12-16T23:09:16.16875619:00:00.000Barcelona217[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Atlético Madrid212[null]male3
42005/200638221.1.019available683422006-01-152019-12-16T23:09:16.16875619:00:00.000Barcelona217[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Athletic Bilbao215[null]male1
52005/200638221.1.015available683212005-12-112020-02-27T12:19:39.45801721:00:00.000Barcelona217[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Sevilla213[null]male1
62005/200638221.1.018available683482006-01-072019-12-16T23:09:16.16875622:00:00.000Espanyol214[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
72005/200638221.1.010available683392005-11-062019-12-16T23:09:16.16875621:00:00.000Getafe216[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male3
82005/200638221.1.012available683192005-11-192019-12-16T23:09:16.16875620:00:00.000Real Madrid220[null]maleSpain2140Regular Season1SpainLa Liga11Spain214Barcelona217[null]male3
92005/200638221.1.08available683182005-10-222019-12-16T23:09:16.16875622:00:00.000Barcelona217[null]maleSpain2143Regular Season1SpainLa Liga11Spain214Osasuna422[null]male0
102005/200638221.1.021available683252006-01-292019-12-16T23:09:16.16875619:00:00.000Mallorca1043[null]maleSpain2140Regular Season1SpainLa Liga11Spain214Barcelona217[null]male3
112005/200638221.1.016available683222005-12-172019-12-16T23:09:16.16875622:00:00.000Cádiz552[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male3
122005/200638221.1.06available683172005-10-012019-12-16T23:09:16.16875620:00:00.000Barcelona217[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Real Zaragoza395[null]male2
132005/200638221.1.024available691722006-02-182019-12-16T23:09:16.16875622:00:00.000Barcelona217[null]maleSpain2145Regular Season1SpainLa Liga11Spain214Real Betis218[null]male1
142005/200638221.1.011available691642005-10-262019-12-16T23:09:16.16875620:30:00.000Barcelona217[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Málaga223[null]male0
152005/200638221.1.020available683242006-01-222019-12-16T23:09:16.16875619:00:00.000Barcelona217[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Deportivo Alavés206[null]male0
162005/200638221.1.017available683232005-12-202019-12-16T23:09:16.16875621:00:00.000Barcelona217[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Celta Vigo209[null]male0
172005/200638221.1.014available683202005-12-042019-12-16T23:09:16.16875619:00:00.000Villarreal222[null]maleSpain2140Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
Rows: 1-17 | Columns: 30

Once we have stored the database, we can easily create a vDataFrame of the relation:

[49]:
data_new = vp.vDataFrame("complex_vmap_test.laliga_to_db")
data_new
[49]:
Abc
season.season_name
Varchar(20)
123
season.season_id
Int
123
metadata.xy_fidelity_version
Int
123
metadata.shot_fidelity_version
Int
📅
metadata.data_version
Date
123
match_week
Int
Abc
match_status
Varchar(20)
123
match_id
Int
📅
match_date
Date
📅
last_updated
Timestamp
📅
kick_off
Time
Abc
home_team.home_team_name
Varchar(26)
123
home_team.home_team_id
Int
Abc
home_team.home_team_group
Varchar(20)
Abc
home_team.home_team_gender
Varchar(20)
Abc
home_team.country.name
Varchar(20)
123
home_team.country.id
Int
123
home_score
Int
Abc
competition_stage.name
Varchar(28)
123
competition_stage.id
Int
Abc
competition.country_name
Varchar(20)
Abc
competition.competition_name
Varchar(20)
123
competition.competition_id
Int
Abc
away_team.country.name
Varchar(20)
123
away_team.country.id
Int
Abc
away_team.away_team_name
Varchar(34)
123
away_team.away_team_id
Int
Abc
away_team.away_team_group
Varchar(20)
Abc
away_team.away_team_gender
Varchar(20)
123
away_score
Int
12005/200638222000-01-0113available683542005-11-272019-12-16 23:09:16.16875621:00:00Barcelona217[null]maleSpain2144Regular Season1SpainLa Liga11Spain214Racing Santander1217[null]male1
22005/200638222000-01-0125available683512006-02-252019-12-16 23:09:16.16875622:00:00Real Zaragoza395[null]maleSpain2140Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
32005/200638222000-01-0122available683502006-02-052019-12-16 23:09:16.16875619:00:00Barcelona217[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Atlético Madrid212[null]male3
42005/200638222000-01-0119available683422006-01-152019-12-16 23:09:16.16875619:00:00Barcelona217[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Athletic Bilbao215[null]male1
52005/200638222000-01-0115available683212005-12-112020-02-27 12:19:39.45801721:00:00Barcelona217[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Sevilla213[null]male1
62005/200638222000-01-0118available683482006-01-072019-12-16 23:09:16.16875622:00:00Espanyol214[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
72005/200638222000-01-0110available683392005-11-062019-12-16 23:09:16.16875621:00:00Getafe216[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male3
82005/200638222000-01-0112available683192005-11-192019-12-16 23:09:16.16875620:00:00Real Madrid220[null]maleSpain2140Regular Season1SpainLa Liga11Spain214Barcelona217[null]male3
92005/200638222000-01-018available683182005-10-222019-12-16 23:09:16.16875622:00:00Barcelona217[null]maleSpain2143Regular Season1SpainLa Liga11Spain214Osasuna422[null]male0
102005/200638222000-01-0121available683252006-01-292019-12-16 23:09:16.16875619:00:00Mallorca1043[null]maleSpain2140Regular Season1SpainLa Liga11Spain214Barcelona217[null]male3
112005/200638222000-01-0116available683222005-12-172019-12-16 23:09:16.16875622:00:00Cádiz552[null]maleSpain2141Regular Season1SpainLa Liga11Spain214Barcelona217[null]male3
122005/200638222000-01-016available683172005-10-012019-12-16 23:09:16.16875620:00:00Barcelona217[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Real Zaragoza395[null]male2
132005/200638222000-01-0124available691722006-02-182019-12-16 23:09:16.16875622:00:00Barcelona217[null]maleSpain2145Regular Season1SpainLa Liga11Spain214Real Betis218[null]male1
142005/200638222000-01-0111available691642005-10-262019-12-16 23:09:16.16875620:30:00Barcelona217[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Málaga223[null]male0
152005/200638222000-01-0120available683242006-01-222019-12-16 23:09:16.16875619:00:00Barcelona217[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Deportivo Alavés206[null]male0
162005/200638222000-01-0117available683232005-12-202019-12-16 23:09:16.16875621:00:00Barcelona217[null]maleSpain2142Regular Season1SpainLa Liga11Spain214Celta Vigo209[null]male0
172005/200638222000-01-0114available683202005-12-042019-12-16 23:09:16.16875619:00:00Villarreal222[null]maleSpain2140Regular Season1SpainLa Liga11Spain214Barcelona217[null]male2
Rows: 1-17 | Columns: 30

Transformations#

First, we load the dataset.

[55]:
data = vp.read_csv(path = path + "cities.csv",
                   schema = "complex_vmap_test",
                   table_name = "cities_transf",
                   ingest_local = False,)
data
[55]:
Abc
name
Varchar(38)
Abc
Varchar(90)
1Abidjan
2Abu Dhabi
3Abuja
4Accra
5Addis Ababa
6Algiers
7Amman
8Amsterdam
9Andorra
10Ankara
11Antananarivo
12Apia
13Ashgabat
14Asmara
15Astana
16Asuncion
17Athens
18Baghdad
19Baku
20Bamako
21Bandar Seri Begawan
22Bangkok
23Bangui
24Banjul
25Basseterre
26Beijing
27Beirut
28Belgrade
29Belmopan
30Berlin
31Bern
32Bishkek
33Bissau
34Bloemfontein
35Bogota
36Brasilia
37Bratislava
38Brazzaville
39Bridgetown
40Brussels
41Bucharest
42Budapest
43Buenos Aires
44Bujumbura
45Cairo
46Canberra
47Cape Town
48Caracas
49Castries
50Chisinau
51Colombo
52Conakry
53Cotonou
54Dakar
55Damascus
56Dar es Salaam
57Dhaka
58Dili
59Djibouti
60Doha
61Dublin
62Dushanbe
63Freetown
64Funafuti
65Gaborone
66Georgetown
67Guatemala
68Hanoi
69Harare
70Hargeysa
71Havana
72Helsinki
73Honiara
74Islamabad
75Jakarta
76Jerusalem
77Johannesburg
78Juba
79Kabul
80Kampala
81Kathmandu
82Khartoum
83Kiev
84Kigali
85Kingston
86Kingstown
87Kinshasa
88Kuala Lumpur
89Kuwait
90København
91La Paz
92Libreville
93Lilongwe
94Lima
95Lisbon
96Ljubljana
97Lome
98London
99Luanda
100Lusaka
Rows: 1-100 | Columns: 2

Once we have data in the form of vDataFrame, we can readily convert it to a JSON file:

[56]:
data.to_json(path = "cities_json.json")

Now we can load the new JSON file and see the contents:

[62]:
data = read_json(path = "cities_json.json",
                 schema = "complex_vmap_test",
                 table_name = "cities_transf_test",
                 ingest_local = False,)
data
[62]:
Abc
Varchar(90)
Abc
name
Varchar(38)
1London
2Accra
3Ouagadougou
4Monrovia
5Freetown
6Conakry
7Bissau
8Nouakchott
9Banjul
10Dakar
11Apia
12Nukualofa
13Reykjavík
14Praia
15Madrid
16Abidjan
17Brasilia
18Yamoussoukro
19Paramaribo
20Montevideo
21Asuncion
22Georgetown
23Buenos Aires
24Bridgetown
25Dublin
26Rabat
27Castries
28Kingstown
29Roseau
30Port-of-Spain
31Saint George's
32Saint John's
33Basseterre
34Sucre
35Caracas
36La Paz
37Santo Domingo
38Santiago
39Port-au-Prince
40Bogota
41Ottawa
42Kingston
43Washington, D.C.
44Lima
45Nassau
46Quito
47Panama City
48Bamako
49Havana
50San Jose
51Managua
52Tegucigalpa
53Belmopan
54San Salvador
55Lisbon
56Guatemala
57Mexico City
58Lome
59Andorra
60Tunis
61Oslo
62Bangkok
63Kuala Lumpur
64Vientiane
65Singapore
66Phnom Penh
67Hanoi
68Jakarta
69Ulaanbaatar
70Yaounde
71Bandar Seri Begawan
72Beijing
73San Marino
74Vatican City
75Rome
76København
77Manila
78Taipei
79Dili
80Pyongyang
81Seoul
82Tripoli
83Luanda
84Berlin
85Melekeok
86Tokyo
87Prague
88Valletta
89Ljubljana
90Port Moresby
91Canberra
92Ndjamena
93Brazzaville
94Kinshasa
95Zagreb
96Palikir
97Honiara
98Vienna
99Port Vila
100Windhoek
Rows: 1-100 | Columns: 2

We can even extract the JSON as string and edit it before saving it as a json file:

[ ]:
json_str = data.to_json()

Let’s look at the begining portion of the string:

[67]:
json_str[0:100]
[67]:
'[\n{"name": "Abidjan", "geometry": "POINT (-4.041994118507091 5.321942826098564)"},\n{"name": "Abu Dha'

We can edit a portion of the string and save it again. We’ll change the name of the first city from Abidjan to Janabid:

[68]:
json_str = json_str[:12] + 'JanAbid' + json_str[19:]

Now we can save this edited strings file:

[ ]:
out_file = open("cities_edited.json", "w")
out_file.write(json_str)
out_file.close()

If we look at the new file, we can see the updated changes:

[ ]:
data = vp.read_json(path = path + "cities_edited.json",
                    schema = "complex_vmap_test",
                    table_name = "cities_edit",
                    ingest_local = False,)

Let’s search for the changed name:

[89]:
data[data["name"] == "JanAbid"]
[89]:
Abc
Varchar(90)
Abc
name
Varchar(38)
1JanAbid
Rows: 1-1 | Columns: 2

Now to clean everything up, we can drop our temporary schema:

[ ]:
vp.drop("complex_vmap_test", method = "schema")

Conclusion#

This new functionality not only make it easy to ingest complex data types in different formats, but it enables data wrangling like never before.

The new features provide increased flexibility while keeping the process and syntax simple. You can do all of the following in VerticaPy:

  • Ingest complex datasets.

  • Perform convenient column operations.

  • Switch data types.

  • Flatten columns and maps into array like structures.