vDataFrame.join

In [ ]:
vDataFrame.join(input_relation, 
                on: Union[dict, list] = {},
                on_interpolate: dict = {},
                how: str = 'natural',
                expr1: list = ['*'],
                expr2: list = ['*'])

Joins the vDataFrame with another vDataFrame or an input relation.

⚠ Warning: Joins can significantly increase the memory consumption of your vDataFrame. You should always check the vDataFrame with the 'current_relation' method and save it to your Vertica database with the 'to_db' method with the parameters 'inplace = True' and 'relation_type = table'

Parameters

Name Type Optional Description
input_relation
str / vDataFrame
Relation to use to do the merging.
on
list / dict
If it is a list then: List of 3-tuples. Each tuple must include (key1, key2, operator) where key1 is the key of the vDataFrame, key2 is the key of the input relation, and operator can be one of the following:
  • '=' : exact match
  • '<' : key1 < key2
  • '>' : key1 > key2
  • '≤' : key1 ≤ key2
  • '≥' : key1 ≥ key2
  • 'llike' : key1 LIKE '%' || key2 || '%'
  • 'rlike' : key2 LIKE '%' || key1 || '%'
  • 'linterpolate': key1 INTERPOLATE key2
  • 'rinterpolate': key2 INTERPOLATE key1
Some operators need 5-tuples: (key1, key2, operator, operator2, x)—where operator2 is a simple operator (=, <, >, ≤, ≥), x is a float or an integer, and operator is one of the following:
  • 'jaro' : JARO(key1, key2) operator2 x
  • 'jarow' : JARO_WINCKLER(key1, key2) operator2 x
  • 'lev' : LEVENSHTEIN(key1, key2) operator2 x
If it is a dictionary then: This parameter must include all the different keys. It must be similar to the following: {"relationA_key1": "relationB_key1" ..., "relationA_keyk": "relationB_keyk"} where relationA is the current vDataFrame and relationB is the input relation or the input vDataFrame.
on_interpolate
dict
A dictionary of all unique keys in the following format:
{"relationA_key1": "relationB_key1" ..., "relationA_keyk": "relationB_keyk"}
where relationA is the current vDataFrame and relationB is the input relation or the input vDataFrame.
These keys are used in joins between two event series using some ordered attribute. Event series joins let you compare values from two series directly and does not require you to normalize the series to the same measurement interval
how
str
Join Type.
  • left : Left Join.
  • right : Right Join.
  • cross : Cross Join.
  • full : Full Outer Join.
  • natural : Natural Join.
  • inner : Inner Join.
expr1
list
List, in pure SQL, of the different columns to select from the current vDataFrame. Aliases are recommended to keep the track of the different features and to avoid ambigious names.
Example: 'column' or 'column AS my_new_alias'.
expr2
list
List, in pure SQL, of the different columns to select from the current vDataFrame. Aliases are recommended to keep the track of the different features and to avoid ambigious names.
Example: 'column' or 'column AS my_new_alias'.

Returns

vDataFrame : object result of the join.

Example

In [1]:
from verticapy import *
flights = vDataFrame("public.flights")
airports = vDataFrame("public.airports")
airlines = vDataFrame("public.airlines")
display(flights)
display(airports)
display(airlines)
123
YEAR
Int
123
MONTH
Int
123
DAY
Int
123
DAY_OF_WEEK
Int
Abc
AIRLINE
Varchar(20)
123
FLIGHT_NUMBER
Int
Abc
TAIL_NUMBER
Varchar(20)
Abc
ORIGIN_AIRPORT
Varchar(20)
Abc
DESTINATION_AIRPORT
Varchar(20)
123
SCHEDULED_DEPARTURE
Int
123
DEPARTURE_TIME
Int
123
DEPARTURE_DELAY
Int
123
TAXI_OUT
Int
123
WHEELS_OFF
Int
123
SCHEDULED_TIME
Int
123
ELAPSED_TIME
Int
123
AIR_TIME
Int
123
DISTANCE
Int
123
WHEELS_ON
Int
123
TAXI_IN
Int
123
SCHEDULED_ARRIVAL
Int
123
ARRIVAL_TIME
Int
123
ARRIVAL_DELAY
Int
123
DIVERTED
Int
123
CANCELLED
Int
Abc
CANCELLATION_REASON
Varchar(20)
123
AIR_SYSTEM_DELAY
Int
123
SECURITY_DELAY
Int
123
AIRLINE_DELAY
Int
123
LATE_AIRCRAFT_DELAY
Int
123
WEATHER_DELAY
Int
120153113AA6N388AAOGGDFW17151710-514172442440038237114464519450-2900[null][null][null][null][null][null]
220153113AA8N378AAHNLDFW16451642-324170644141338537844314506435-3100[null][null][null][null][null][null]
320153113AA10N793AALAXJFK22102202-819222132131729024756118631619-1200[null][null][null][null][null][null]
420153113AA14N5ECAAOGGLAX21592156-311220731127125324865207610527-4300[null][null][null][null][null][null]
520153113AA21N794AAJFKLAX18451839-613185239135033424752126322162129-4700[null][null][null][null][null][null]
620153113AA27N5BRAADFWLAS18501852220191217917414910551941519491946-300[null][null][null][null][null][null]
720153113AA30N799AALAXJFK23252322-321234332333130424757476748753500[null][null][null][null][null][null]
820153113AA37N3JYAADFWSAN21002058-2242122185207174117122169220522252000[null]200000
920153113AA41N3CNAAORDSEA20502116261921352752732391721233415232523492400[null]001230
1020153113AA45N3JDAAJFKLAS17291727-216174335633030822481951620251957-2800[null][null][null][null][null][null]
1120153113AA49N630AADFWSAN19351940518195818617515411712032320412035-600[null][null][null][null][null][null]
1220153113AA51N4YBAADFWSLC1725172831817461711721459891911919161920400[null][null][null][null][null][null]
1320153113AA60N380AADFWMIA1755180914181827160169143112121508213521582300[null]901400
1420153113AA63N3CKAAMIAPHX1955201217202032324303256197221482722192215-400[null][null][null][null][null][null]
1520153113AA65N3DHAAJFKDFW16151611-4191630256252213139119032019311923-800[null][null][null][null][null][null]
1620153113AA69N3GYAAMIASFO184018591912191139335734125852152422132156-1700[null][null][null][null][null][null]
1720153113AA71N3ACAADFWSAN18051807214182118618716911711910419111914300[null][null][null][null][null][null]
1820153113AA75N3HGAAIADLAX1831184413131857361342315228821121421322126-600[null][null][null][null][null][null]
1920153113AA81N471AADFWTUS22452257121823151421331108132305523072310300[null][null][null][null][null][null]
2020153113AA87N491AAORDRNO19001857-311190826723822316712051421272055-3200[null][null][null][null][null][null]
2120153113AA93N3JKAAORDSAN1720174929201809261243220172319493194119521100[null][null][null][null][null][null]
2220153113AA95N3JHAAJFKSAN17201718-214173238034632924462001320402004-3600[null][null][null][null][null][null]
2320153113AA102N353AAHNLDFW18301836627190344043640437846475650652200[null][null][null][null][null][null]
2420153113AA103N503AAMSYDFW16151631169164010374634471743217581745-1300[null][null][null][null][null][null]
2520153113AA111N3LJAAORDSNA172017311121175226324321817261930419431934-900[null][null][null][null][null][null]
2620153113AA113N3JWAAMIADEN21152105-1011211627524122417092300623502306-4400[null][null][null][null][null][null]
2720153113AA122N864AADFWMCO19101908-216192414015913798522416223022471700[null]170000
2820153113AA125N528AAATLDFW17501744-613175715313410573118421619231858-2500[null][null][null][null][null][null]
2920153113AA128N3EYAADFWIAD20202020017203715315813411722351723532358500[null][null][null][null][null][null]
3020153113AA132N436AAPHLDFW18351832-3421914249249188130321221921442141-300[null][null][null][null][null][null]
3120153113AA133N789AAJFKLAX162917104119172940236733924752008920112017600[null][null][null][null][null][null]
3220153113AA134N3BLAADCADFW1745192095121932216200179119221319202121407900[null]0049300
3320153113AA138N3FAAADFWDCA16551653-213170615915513811922024420342028-600[null][null][null][null][null][null]
3420153113AA142N4XVAAMKEDFW1810184434111855164145119853205415205421091500[null]00870
3520153113AA143N3JVAAMIALAX18491847-2221909369326294234221031021582113-4500[null][null][null][null][null][null]
3620153113AA145N3FWAAMIASAN20052000-515201534529527722672152322502155-5500[null][null][null][null][null][null]
3720153113AA146N3GWAAMIABOS21002100012211218216915212582344522349-1300[null][null][null][null][null][null]
3820153113AA147N528AADFWSLC2105210501921241691561329892236522542241-1300[null][null][null][null][null][null]
3920153113AA151N3BWAADENORD18171810-72518351381491168882131821352139400[null][null][null][null][null][null]
4020153113AA154N3GSAAORDMCO1955200611202026152157128100523349232723431600[null]50560
4120153113AA155N3LAAALAXORD17451754928182224123720217442344723462351500[null][null][null][null][null][null]
4220153113AA156N3FSAAORDSAN21252149248215725922621517232332323442335-900[null][null][null][null][null][null]
4320153113AA161N5ECAALAXOGG17301724-6171741359379360248620412202920431400[null][null][null][null][null][null]
4420153113AA163N797AAJFKSFO19551951-412200340037235625862259423352303-3200[null][null][null][null][null][null]
4520153113AA165N3LKAABOSLAX162016288231651399379344261119351219591947-1200[null][null][null][null][null][null]
4620153113AA180N787AALAXJFK16551725302717523223513142475206101172165900[null]2903000
4720153113AA181N799AAJFKLAX17351725-10271752400409346247520383621152114-100[null][null][null][null][null][null]
4820153113AA182N3FRAALAXLAS1805180502018257472462361911619191917-200[null][null][null][null][null][null]
4920153113AA185N788AAJFKLAX21052059-629212840038532824752356284524-2100[null][null][null][null][null][null]
5020153113AA188N3HEAARSWDFW173017300141744185162130101718541819351912-2300[null][null][null][null][null][null]
5120153113AA192N3HXAALAXBOS21452141-416215732731629426115516612557-1500[null][null][null][null][null][null]
5220153113AA197N3LWAASFOORD17311738717175524323120918462324523342329-500[null][null][null][null][null][null]
5320153113AA199N3BDAAJFKORD17101706-412171817616613074018282419061852-1400[null][null][null][null][null][null]
5420153113AA207N3FFAAMIALAS200020141423203733930727721742214722392221-1800[null][null][null][null][null][null]
5520153113AA209N3GVAALAXSFO16251622-31916418476543371735317491738-1100[null][null][null][null][null][null]
5620153113AA209N3GVAASFOLAX18401833-710184391755433719371120111948-2300[null][null][null][null][null][null]
5720153113AA219N3ABAALAXSFO18451838-72319018684563371957520112002-900[null][null][null][null][null][null]
5820153113AA219N3ABAASFOLAX21012053-8192112921015433722062822332234100[null][null][null][null][null][null]
5920153113AA220N862AAMIATPA170518126717182972664520419144181719186100[null]0029320
6020153113AA220N862AATPAMIA191119584712201066553520420458201720533600[null]000360
6120153113AA223N3JRAABOSLAX20011953-8142007401376349261122561323422309-3300[null][null][null][null][null][null]
6220153113AA227N3FGAADFWMSP2045204721421011351291098522250623002256-400[null][null][null][null][null][null]
6320153113AA231N3KMAALASORD16171614-313162720320618615142133721402140000[null][null][null][null][null][null]
6420153113AA232N434AAATLDFW19091906-31419201521239973119591020412009-3200[null][null][null][null][null][null]
6520153113AA234N3CXAAMIABWI21352130-51321431541371219462344392347-2200[null][null][null][null][null][null]
6620153113AA235N3HWAAJFKSEA18351829-6141843384379353242221361221592148-1100[null][null][null][null][null][null]
6720153113AA238N3CEAADCAMIA18051804-115181916716413991920381020522048-400[null][null][null][null][null][null]
6820153113AA245N3LFAADCALAX1715172510141739362345311231119502020172010-700[null][null][null][null][null][null]
6920153113AA246N5FCAAKOALAX213021300152145310[null][null]2504[null][null]540[null][null]10[null][null][null][null][null][null]
7020153113AA247N5FCAALAXKOA17001658-2161714360375355250420094200020131300[null][null][null][null][null][null]
7120153113AA263N5DJAAMCOLAX16301626-413163934431229022181829919141838-3600[null][null][null][null][null][null]
7220153113AA267N5ESAALAXHNL18301821-9181839372409387255622064214222102800[null]280000
7320153113AA268N597AADFWSJC211021271722214922922019514382304322592307800[null][null][null][null][null][null]
7420153113AA272N3ADAASFOMIA23502346-4162310330308258581068008161600[null]160000
7520153113AA280N383AADFWMIA185518594181917157169143112122408223222481600[null]160000
7620153113AA288N3BDAAORDBOS20052004-11620201291271028672302923142311-300[null][null][null][null][null][null]
7720153113AA291N3FDAAJFKAUS17001658-216171426524422315211957520252002-2300[null][null][null][null][null][null]
7820153113AA293N791AAJFKLAX19451944-1172001398372324247522253123232256-2700[null][null][null][null][null][null]
7920153113AA294N466AAORFDFW17081702-6181720222225184121219242319501947-300[null][null][null][null][null][null]
8020153113AA296N564AADFWSAT17201920120121932666445247201771826202411800[null]0019990
8120153113AA296N564AASATDFW19062059113112110696041247215182015215910400[null]0001040
8220153113AA297N5DEAALAXHNL16261621-5251646371423391255620177193720244700[null]470000
8320153113AA298N5DEAAHNLLAX210721453815220032628626525565256533531-200[null][null][null][null][null][null]
8420153113AA301N4XEAADFWTUS200520282317204514513811681320415203020461600[null]001420
8520153113AA312N5FLAAMIAJFK19501958818201617315613110892227722432234-900[null][null][null][null][null][null]
8620153113AA335N560AAORDTUS1959203132112042234200177143721391221532151-200[null][null][null][null][null][null]
8720153113AA340N489AADFWHOU21502209199221863625024723083225323111800[null]001800
8820153113AA341N4XEAAAUSDFW1744181834141832666537190190914185019233300[null]000330
8920153113AA342N3FXAAMIALGA17001656-421171718216213710961934420021938-2400[null][null][null][null][null][null]
9020153113AA344N3FCAADENMIA17151710-513172322622520517092248723012255-600[null][null][null][null][null][null]
9120153113AA345N3LTAALGAORD17091716723173917116312773318461319001859-100[null][null][null][null][null][null]
9220153113AA346N3LTAAORDLGA19551951-41120021201119073322321022552242-1300[null][null][null][null][null][null]
9320153113AA348N3HYAAMIAMSY20052002-32320251321291036752108321172111-600[null][null][null][null][null][null]
9420153113AA349N028AAMIAATL18151807-81518221241138559419471320192000-1900[null][null][null][null][null][null]
9520153113AA350N3CJAAORDLGA17501856661319091241068873321375205421424800[null]0036120
9620153113AA351N3JYAAIAHDFW1710174939171806737040224184613182318593600[null]002340
9720153113AA352N3MBAAORDLGA18451838-7211859122118897332128821472136-1100[null][null][null][null][null][null]
9820153113AA354N3KFAAORDLGA16351631-4151646123112907331916719381923-1500[null][null][null][null][null][null]
9920153113AA355N3MHAALGAORD18051758-72518231711501177331920819561928-2800[null][null][null][null][null][null]
10020153113AA356N006AAATLDFW1644164511517001511301097311749618151755-2000[null][null][null][null][null][null]
Rows: 1-100 | Columns: 31
Abc
IATA_CODE
Varchar(20)
Abc
Varchar(156)
Abc
CITY
Varchar(60)
Abc
STATE
Varchar(20)
Abc
COUNTRY
Varchar(20)
🌎
LATITUDE
Numeric(10,6)
🌎
LONGITUDE
Numeric(11,6)
1ABEAllentownPAUSA40.65236-75.4404
2ABIAbileneTXUSA32.41132-99.6819
3ABQAlbuquerqueNMUSA35.04022-106.60919
4ABRAberdeenSDUSA45.44906-98.42183
5ABYAlbanyGAUSA31.53552-84.19447
6ACKNantucketMAUSA41.25305-70.06018
7ACTWacoTXUSA31.61129-97.23052
8ACVArcata/EurekaCAUSA40.97812-124.10862
9ACYAtlantic CityNJUSA39.45758-74.57717
10ADKAdakAKUSA51.87796-176.64603
11ADQKodiakAKUSA57.74997-152.49386
12AEXAlexandriaLAUSA31.32737-92.54856
13AGSAugustaGAUSA33.36996-81.9645
14AKNKing SalmonAKUSA58.6768-156.64922
15ALBAlbanyNYUSA42.74812-73.80298
16ALOWaterlooIAUSA42.55708-92.40034
17AMAAmarilloTXUSA35.21937-101.70593
18ANCAnchorageAKUSA61.17432-149.99619
19APNAlpenaMIUSA45.07807-83.56029
20ASEAspenCOUSA39.22316-106.86885
21ATLAtlantaGAUSA33.64044-84.42694
22ATWAppletonWIUSA44.25741-88.51948
23AUSAustinTXUSA30.19453-97.66987
24AVLAshevilleNCUSA35.43619-82.54181
25AVPWilkes-Barre/ScrantonPAUSA41.33815-75.72427
26AZOKalamazooMIUSA42.23488-85.55206
27BDLWindsor LocksCTUSA41.93887-72.68323
28BETBethelAKUSA60.77978-161.838
29BFLBakersfieldCAUSA35.4336-119.05677
30BGMBinghamtonNYUSA42.20848-75.97961
31BGRBangorMEUSA44.80744-68.82814
32BHMBirminghamALUSA33.56294-86.75355
33BILBillingsMTUSA45.80766-108.54286
34BISBismarckNDUSA46.77411-100.74672
35BJIBemidjiMNUSA47.50942-94.93372
36BLIBellinghamWAUSA48.79275-122.53753
37BMIBloomingtonILUSA40.47799-88.91595
38BNANashvilleTNUSA36.12448-86.67818
39BOIBoiseIDUSA43.56444-116.22278
40BOSBostonMAUSA42.36435-71.00518
41BPTBeaumont/Port ArthurTXUSA29.95083-94.02069
42BQKBrunswickGAUSA31.25903-81.46631
43BQNAguadillaPRUSA18.49486-67.12944
44BRDBrainerdMNUSA46.39786-94.13723
45BROBrownsvilleTXUSA25.90683-97.42586
46BRWBarrowAKUSA71.28545-156.766
47BTMButteMTUSA45.9548-112.49746
48BTRBaton RougeLAUSA30.53316-91.14963
49BTVBurlingtonVTUSA44.473-73.15031
50BUFBuffaloNYUSA42.94052-78.73217
51BURBurbankCAUSA34.20062-118.3585
52BWIBaltimoreMDUSA39.1754-76.6682
53BZNBozemanMTUSA45.7769-111.15301
54CAEColumbiaSCUSA33.93884-81.11954
55CAKAkronOHUSA40.91631-81.44247
56CDCCedar CityUTUSA37.70097-113.09858
57CDVCordovaAKUSA60.49183-145.47765
58CECCrescent CityCAUSA41.78016-124.23653
59CHAChattanoogaTNUSA35.03527-85.20379
60CHOCharlottesvilleVAUSA38.13864-78.45286
61CHSCharlestonSCUSA32.89865-80.04051
62CIDCedar RapidsIAUSA41.88459-91.71087
63CIUSault Ste. MarieMIUSA46.25075-84.47239
64CLDSan DiegoCAUSA33.12723-117.27873
65CLEClevelandOHUSA41.41089-81.8494
66CLLCollege StationTXUSA30.58859-96.36382
67CLTCharlotteNCUSA35.21401-80.94313
68CMHColumbusOHUSA39.99799-82.89188
69CMIChampaign/UrbanaILUSA40.03925-88.27806
70CMXHancockMIUSA47.16842-88.48906
71CNYMoabUTUSA38.75496-109.75484
72CODCodyWYUSA44.52019-109.0238
73COSColorado SpringsCOUSA38.80581-104.70025
74COUColumbiaMOUSA38.81809-92.21963
75CPRCasperWYUSA42.90836-106.46447
76CRPCorpus ChristiTXUSA27.77036-97.50122
77CRWCharlestonWVUSA38.37315-81.59319
78CSGColumbusGAUSA32.51633-84.93886
79CVGCovingtonKYUSA39.04614-84.66217
80CWAMosineeWIUSA44.77762-89.66678
81DABDaytona BeachFLUSA29.17992-81.05806
82DALDallasTXUSA32.84711-96.85177
83DAYDaytonOHUSA39.90238-84.21938
84DBQDubuqueIAUSA42.40296-90.70917
85DCAArlingtonVAUSA38.85208-77.03772
86DENDenverCOUSA39.85841-104.667
87DFWDallas-Fort WorthTXUSA32.89595-97.0372
88DHNDothanALUSA31.32134-85.44963
89DIKDickinsonNDUSA46.79739-102.80195
90DLGDillinghamAKUSA59.04541-158.50334
91DLHDuluthMNUSA46.84209-92.19365
92DRODurangoCOUSA37.15152-107.75377
93DSMDes MoinesIAUSA41.53493-93.66068
94DTWDetroitMIUSA42.21206-83.34884
95DVLDevils LakeNDUSA48.11425-98.90878
96EAUEau ClaireWIUSA44.86526-91.48507
97ECPPanama CityFLUSA[null][null]
98EGEEagleCOUSA39.64257-106.9177
99EKOElkoNVUSA40.82493-115.7917
100ELMElmiraNYUSA42.15991-76.89144
Rows: 1-100 | Columns: 7
Abc
IATA_CODE
Varchar(20)
Abc
AIRLINE
Varchar(56)
1AAAmerican Airlines Inc.
2ASAlaska Airlines Inc.
3B6JetBlue Airways
4DLDelta Air Lines Inc.
5EVAtlantic Southeast Airlines
6F9Frontier Airlines Inc.
7HAHawaiian Airlines Inc.
8MQAmerican Eagle Airlines Inc.
9NKSpirit Air Lines
10OOSkywest Airlines Inc.
11UAUnited Air Lines Inc.
12USUS Airways Inc.
13VXVirgin America
14WNSouthwest Airlines Co.
Rows: 1-14 | Columns: 2
In [18]:
# Cross Join
airports.join(airports, 
              how = "cross", 
              expr1 = ["IATA_CODE AS airport1", 
                       "LATITUDE AS airport1_latitude", 
                       "LONGITUDE AS airport1_longitude"],
              expr2 = ["IATA_CODE AS airport2", 
                       "LATITUDE AS airport2_latitude", 
                       "LONGITUDE AS airport2_longitude"])
Abc
airport1
Varchar(20)
123
airport1_latitude
Numeric(10,6)
123
airport1_longitude
Numeric(11,6)
Abc
airport2
Varchar(20)
123
airport2_latitude
Numeric(10,6)
123
airport2_longitude
Numeric(11,6)
1ABE40.652360-75.440400ABE40.652360-75.440400
2ABE40.652360-75.440400ABI32.411320-99.681900
3ABE40.652360-75.440400ABQ35.040220-106.609190
4ABE40.652360-75.440400ABR45.449060-98.421830
5ABE40.652360-75.440400ABY31.535520-84.194470
6ABE40.652360-75.440400ACK41.253050-70.060180
7ABE40.652360-75.440400ACT31.611290-97.230520
8ABE40.652360-75.440400ACV40.978120-124.108620
9ABE40.652360-75.440400ACY39.457580-74.577170
10ABE40.652360-75.440400ADK51.877960-176.646030
11ABE40.652360-75.440400ADQ57.749970-152.493860
12ABE40.652360-75.440400AEX31.327370-92.548560
13ABE40.652360-75.440400AGS33.369960-81.964500
14ABE40.652360-75.440400AKN58.676800-156.649220
15ABE40.652360-75.440400ALB42.748120-73.802980
16ABE40.652360-75.440400ALO42.557080-92.400340
17ABE40.652360-75.440400AMA35.219370-101.705930
18ABE40.652360-75.440400ANC61.174320-149.996190
19ABE40.652360-75.440400APN45.078070-83.560290
20ABE40.652360-75.440400ASE39.223160-106.868850
21ABE40.652360-75.440400ATL33.640440-84.426940
22ABE40.652360-75.440400ATW44.257410-88.519480
23ABE40.652360-75.440400AUS30.194530-97.669870
24ABE40.652360-75.440400AVL35.436190-82.541810
25ABE40.652360-75.440400AVP41.338150-75.724270
26ABE40.652360-75.440400AZO42.234880-85.552060
27ABE40.652360-75.440400BDL41.938870-72.683230
28ABE40.652360-75.440400BET60.779780-161.838000
29ABE40.652360-75.440400BFL35.433600-119.056770
30ABE40.652360-75.440400BGM42.208480-75.979610
31ABE40.652360-75.440400BGR44.807440-68.828140
32ABE40.652360-75.440400BHM33.562940-86.753550
33ABE40.652360-75.440400BIL45.807660-108.542860
34ABE40.652360-75.440400BIS46.774110-100.746720
35ABE40.652360-75.440400BJI47.509420-94.933720
36ABE40.652360-75.440400BLI48.792750-122.537530
37ABE40.652360-75.440400BMI40.477990-88.915950
38ABE40.652360-75.440400BNA36.124480-86.678180
39ABE40.652360-75.440400BOI43.564440-116.222780
40ABE40.652360-75.440400BOS42.364350-71.005180
41ABE40.652360-75.440400BPT29.950830-94.020690
42ABE40.652360-75.440400BQK31.259030-81.466310
43ABE40.652360-75.440400BQN18.494860-67.129440
44ABE40.652360-75.440400BRD46.397860-94.137230
45ABE40.652360-75.440400BRO25.906830-97.425860
46ABE40.652360-75.440400BRW71.285450-156.766000
47ABE40.652360-75.440400BTM45.954800-112.497460
48ABE40.652360-75.440400BTR30.533160-91.149630
49ABE40.652360-75.440400BTV44.473000-73.150310
50ABE40.652360-75.440400BUF42.940520-78.732170
51ABE40.652360-75.440400BUR34.200620-118.358500
52ABE40.652360-75.440400BWI39.175400-76.668200
53ABE40.652360-75.440400BZN45.776900-111.153010
54ABE40.652360-75.440400CAE33.938840-81.119540
55ABE40.652360-75.440400CAK40.916310-81.442470
56ABE40.652360-75.440400CDC37.700970-113.098580
57ABE40.652360-75.440400CDV60.491830-145.477650
58ABE40.652360-75.440400CEC41.780160-124.236530
59ABE40.652360-75.440400CHA35.035270-85.203790
60ABE40.652360-75.440400CHO38.138640-78.452860
61ABE40.652360-75.440400CHS32.898650-80.040510
62ABE40.652360-75.440400CID41.884590-91.710870
63ABE40.652360-75.440400CIU46.250750-84.472390
64ABE40.652360-75.440400CLD33.127230-117.278730
65ABE40.652360-75.440400CLE41.410890-81.849400
66ABE40.652360-75.440400CLL30.588590-96.363820
67ABE40.652360-75.440400CLT35.214010-80.943130
68ABE40.652360-75.440400CMH39.997990-82.891880
69ABE40.652360-75.440400CMI40.039250-88.278060
70ABE40.652360-75.440400CMX47.168420-88.489060
71ABE40.652360-75.440400CNY38.754960-109.754840
72ABE40.652360-75.440400COD44.520190-109.023800
73ABE40.652360-75.440400COS38.805810-104.700250
74ABE40.652360-75.440400COU38.818090-92.219630
75ABE40.652360-75.440400CPR42.908360-106.464470
76ABE40.652360-75.440400CRP27.770360-97.501220
77ABE40.652360-75.440400CRW38.373150-81.593190
78ABE40.652360-75.440400CSG32.516330-84.938860
79ABE40.652360-75.440400CVG39.046140-84.662170
80ABE40.652360-75.440400CWA44.777620-89.666780
81ABE40.652360-75.440400DAB29.179920-81.058060
82ABE40.652360-75.440400DAL32.847110-96.851770
83ABE40.652360-75.440400DAY39.902380-84.219380
84ABE40.652360-75.440400DBQ42.402960-90.709170
85ABE40.652360-75.440400DCA38.852080-77.037720
86ABE40.652360-75.440400DEN39.858410-104.667000
87ABE40.652360-75.440400DFW32.895950-97.037200
88ABE40.652360-75.440400DHN31.321340-85.449630
89ABE40.652360-75.440400DIK46.797390-102.801950
90ABE40.652360-75.440400DLG59.045410-158.503340
91ABE40.652360-75.440400DLH46.842090-92.193650
92ABE40.652360-75.440400DRO37.151520-107.753770
93ABE40.652360-75.440400DSM41.534930-93.660680
94ABE40.652360-75.440400DTW42.212060-83.348840
95ABE40.652360-75.440400DVL48.114250-98.908780
96ABE40.652360-75.440400EAU44.865260-91.485070
97ABE40.652360-75.440400ECP[null][null]
98ABE40.652360-75.440400EGE39.642570-106.917700
99ABE40.652360-75.440400EKO40.824930-115.791700
100ABE40.652360-75.440400ELM42.159910-76.891440
Out[18]:
Rows: 1-100 of 103684 | Columns: 6
In [19]:
# Left Join
flights.join(airlines,
             how = "left",
             on = [("airline": "IATA_CODE", "=")],
             expr1 = ["*"],
             expr2 = ["AIRLINE AS airline_long"])
123
YEAR
Int
123
MONTH
Int
123
DAY
Int
123
DAY_OF_WEEK
Int
Abc
AIRLINE
Varchar(20)
123
FLIGHT_NUMBER
Int
Abc
TAIL_NUMBER
Varchar(20)
Abc
ORIGIN_AIRPORT
Varchar(20)
Abc
DESTINATION_AIRPORT
Varchar(20)
123
SCHEDULED_DEPARTURE
Int
123
DEPARTURE_TIME
Int
123
DEPARTURE_DELAY
Int
123
TAXI_OUT
Int
123
WHEELS_OFF
Int
123
SCHEDULED_TIME
Int
123
ELAPSED_TIME
Int
123
AIR_TIME
Int
123
DISTANCE
Int
123
WHEELS_ON
Int
123
TAXI_IN
Int
123
SCHEDULED_ARRIVAL
Int
123
ARRIVAL_TIME
Int
123
ARRIVAL_DELAY
Int
123
DIVERTED
Int
123
CANCELLED
Int
Abc
CANCELLATION_REASON
Varchar(20)
123
AIR_SYSTEM_DELAY
Int
123
SECURITY_DELAY
Int
123
AIRLINE_DELAY
Int
123
LATE_AIRCRAFT_DELAY
Int
123
WEATHER_DELAY
Int
Abc
airline_long
Varchar(56)
120155155DL2242N979DLDTWIND13501356643143964883923115186145415243000[null]240600Delta Air Lines Inc.
220155155DL2242N979DLINDDTW153516002513161370634523116585164517031800[null]000180Delta Air Lines Inc.
320155155DL2243N924DNMSPTPA912908-41191919117816313061302413231306-1700[null][null][null][null][null][null]Delta Air Lines Inc.
420155155DL2243N924DNTPAMSP14151412-311142320118616713061610816361618-1800[null][null][null][null][null][null]Delta Air Lines Inc.
520155155DL2244N347NBMSPSNA945942-31795923622620415221123511411128-1300[null][null][null][null][null][null]Delta Air Lines Inc.
620155155DL2245N673DLRSWMSP13301329-111134021219017114161531816021539-2300[null][null][null][null][null][null]Delta Air Lines Inc.
720155155DL2246N587NWHNLSEA20202026619204533833731426774594458503500[null][null][null][null][null][null]Delta Air Lines Inc.
820155155DL2247N554NWATLPBI22592302316231810195725453074037-300[null][null][null][null][null][null]Delta Air Lines Inc.
920155155DL2248N351NBDTWLGA15271525-2171542108103805021702617151708-700[null][null][null][null][null][null]Delta Air Lines Inc.
1020155155DL2249N942DLATLIAH22102208-2102218136113946892252923262301-2500[null][null][null][null][null][null]Delta Air Lines Inc.
1120155155DL2250N342NBATLGSP85992829159435446271531010495310142100[null]004170Delta Air Lines Inc.
1220155155DL2250N342NBGSPATL1028105628151111625833153114410113011542400[null]006180Delta Air Lines Inc.
1320155155DL2251N945DLATLCLT1000958-21610147963412261055611191101-1800[null][null][null][null][null][null]Delta Air Lines Inc.
1420155155DL2251N945DLCLTATL12001152-82812208483472261307813241315-900[null][null][null][null][null][null]Delta Air Lines Inc.
1520155155DL2252N917DECHSATL845842-311853777754259947121002959-300[null][null][null][null][null][null]Delta Air Lines Inc.
1620155155DL2253N594NWMSPSEA173517511614180521219517613991901519071906-100[null][null][null][null][null][null]Delta Air Lines Inc.
1720155155DL2254N814DNLAXATL55117221413125923821919478105814815100[null][null][null][null][null][null]Delta Air Lines Inc.
1820155155DL2255N654DLATLLAX204020591916211529527825619472231622352237200[null][null][null][null][null][null]Delta Air Lines Inc.
1920155155DL2256N550NWATLMCI145515343917155113312210169216324160816362800[null]000280Delta Air Lines Inc.
2020155155DL2256N550NWMCIATL16581735371517501221169469220247200020313100[null]008230Delta Air Lines Inc.
2120155155DL2257N314NBSLCSNA11301126-4111137114104885881205512241210-1400[null][null][null][null][null][null]Delta Air Lines Inc.
2220155155DL2258N816DNATLSMF19301927-311193830628126720922105321362108-2800[null][null][null][null][null][null]Delta Air Lines Inc.
2320155155DL2258N816DNSMFATL22442241-3112252261275257209260976056161100[null][null][null][null][null][null]Delta Air Lines Inc.
2420155155DL2259N804DNMSPSLC1140114771512021671581409911322313271325-200[null][null][null][null][null][null]Delta Air Lines Inc.
2520155155DL2260N543USPBIATL540536-41354910099775457069720715-500[null][null][null][null][null][null]Delta Air Lines Inc.
2620155155DL2261N954ATATLDAL8218210188391331331117219304934934000[null][null][null][null][null][null]Delta Air Lines Inc.
2720155155DL2261N954ATDALATL1010101001410241281199572112591013181309-900[null][null][null][null][null][null]Delta Air Lines Inc.
2820155155DL2262N707TWLAXJFK134013433141357334309284247521411122142152-2200[null][null][null][null][null][null]Delta Air Lines Inc.
2920155155DL2263N909DEJFKMIA15351533-224155721018315110891828819051836-2900[null][null][null][null][null][null]Delta Air Lines Inc.
3020155155DL2264N906DADENMSP600554-612606118114996808453858848-1000[null][null][null][null][null][null]Delta Air Lines Inc.
3120155155DL2265N393DACMHLAX643637-6136502923152721995822308358521700[null]170000Delta Air Lines Inc.
3220155155DL2266N375NCCLTMSP615608-7166241691541349307384804742-2200[null][null][null][null][null][null]Delta Air Lines Inc.
3320155155DL2267N681DAATLSAN11101107-311111828127225718921235412511239-1200[null][null][null][null][null][null]Delta Air Lines Inc.
3420155155DL2267N681DASANATL13451339-6171356254256216189220322320592055-400[null][null][null][null][null][null]Delta Air Lines Inc.
3520155155DL2268N324USCLTDTW17101704-6101714112110935001847719021854-800[null][null][null][null][null][null]Delta Air Lines Inc.
3620155155DL2269N185DNATLMCO11551148-71412028385634041305813181313-500[null][null][null][null][null][null]Delta Air Lines Inc.
3720155155DL2269N185DNMCOATL14201417-32814459997604041545915591554-500[null][null][null][null][null][null]Delta Air Lines Inc.
3820155155DL2270N910DLLGARSW815815045900196209159108011395113111441300[null][null][null][null][null][null]Delta Air Lines Inc.
3920155155DL2271N932DNPBIATL930927-3129391071108154511001711171117000[null][null][null][null][null][null]Delta Air Lines Inc.
4020155155DL2272N674DLATLSRQ15091506-31515219282644441625316411628-1300[null][null][null][null][null][null]Delta Air Lines Inc.
4120155155DL2272N674DLSRQATL17311725-615174010087664441846619111852-1900[null][null][null][null][null][null]Delta Air Lines Inc.
4220155155DL2273N935ATGSOATL700656-4167128182593068117821818-300[null][null][null][null][null][null]Delta Air Lines Inc.
4320155155DL2274N957DLDTWRDU13501345-51514009794755011515415271519-800[null][null][null][null][null][null]Delta Air Lines Inc.
4420155155DL2274N957DLRDUDTW170517050241729111115875011856418561900400[null][null][null][null][null][null]Delta Air Lines Inc.
4520155155DL2275N917DEATLORF204520581318211610091695162225422252229400[null][null][null][null][null][null]Delta Air Lines Inc.
4620155155DL2276N967DLMCOJFK19551949-61820071671551309442217722422224-1800[null][null][null][null][null][null]Delta Air Lines Inc.
4720155155DL2277N938ATJFKTPA184018501025191519316713910052134321532137-1600[null][null][null][null][null][null]Delta Air Lines Inc.
4820155155DL2279N924DNMSPSJC17431740-318175824223721615761934319451937-800[null][null][null][null][null][null]Delta Air Lines Inc.
4920155155DL2280N910ATLGATPA83583611885417416013910101113311291116-1300[null][null][null][null][null][null]Delta Air Lines Inc.
5020155155DL2281N977DLATLIND170817102371747971066443218515184518561100[null][null][null][null][null][null]Delta Air Lines Inc.
5120155155DL2281N977DLINDATL19251935102219579810664432210120210321211800[null]800100Delta Air Lines Inc.
5220155155DL2282N913DELGAMCO20041957-71820151761441249502219223002221-3900[null][null][null][null][null][null]Delta Air Lines Inc.
5320155155DL2283N585NWDTWATL605607214621118113935947546803800-300[null][null][null][null][null][null]Delta Air Lines Inc.
5420155155DL2284N317USSLCSMF11421139-31111509787735321203312191206-1300[null][null][null][null][null][null]Delta Air Lines Inc.
5520155155DL2285N911DELGAMCO705656-9347301631871439509531094810031500[null]150000Delta Air Lines Inc.
5620155155DL2286N326USABQSLC605603-21061310087694937228745730-1500[null][null][null][null][null][null]Delta Air Lines Inc.
5720155155DL2287N331NWDENDTW1605163126311702173178138112321209205821293100[null]503230Delta Air Lines Inc.
5820155155DL2288N996DLATLBHM13451339-61213515644261341317613411323-1800[null][null][null][null][null][null]Delta Air Lines Inc.
5920155155DL2289N921DLATLAVL20502049-11521046052331642137421502141-900[null][null][null][null][null][null]Delta Air Lines Inc.
6020155155DL2290N913DEPITATL700655-5127071051078552683210845842-300[null][null][null][null][null][null]Delta Air Lines Inc.
6120155155DL2291N343NBATLCLE19301929-1141943110105835542106821202114-600[null][null][null][null][null][null]Delta Air Lines Inc.
6220155155DL2292N939DLJFKPBI805757-83983618718714310281059511121104-800[null][null][null][null][null][null]Delta Air Lines Inc.
6320155155DL2293N310NWATLELP19311927-414194120619417612822037420572041-1600[null][null][null][null][null][null]Delta Air Lines Inc.
6420155155DL2294N359NWGSOATL525641761765871835930675776368048800[null]1207600Delta Air Lines Inc.
6520155155DL2295N356NWSANSLC13351405301714221131068462616465162816512300[null]000230Delta Air Lines Inc.
6620155155DL2296N326NBMSPLGA17311730-110174016914913110202051821202059-2100[null][null][null][null][null][null]Delta Air Lines Inc.
6720155155DL2297N908DAATLJAX13501402121414167561432701459415051503-200[null][null][null][null][null][null]Delta Air Lines Inc.
6820155155DL2297N908DAJAXATL154515527916018064472701648817051656-900[null][null][null][null][null][null]Delta Air Lines Inc.
6920155155DL2298N667DNATLSRQ905901-4119128775624441014210321016-1600[null][null][null][null][null][null]Delta Air Lines Inc.
7020155155DL2298N667DNSRQATL11221119-3131132100906644412381113021249-1300[null][null][null][null][null][null]Delta Air Lines Inc.
7120155155DL2300N325USATLBOS214021571714221115814912594616101826800[null][null][null][null][null][null]Delta Air Lines Inc.
7220155155DL2301N339NBJFKSAT17451737-823180026924722015872040421142044-3000[null][null][null][null][null][null]Delta Air Lines Inc.
7320155155DL2302N928DLDCADTW19331927-61519429293724052054621052100-500[null][null][null][null][null][null]Delta Air Lines Inc.
7420155155DL2303N366NBDTWGRR2007201141820295846241202053421052057-800[null][null][null][null][null][null]Delta Air Lines Inc.
7520155155DL2304N542USATLTPA21502149-11122008676604062300523162305-1100[null][null][null][null][null][null]Delta Air Lines Inc.
7620155155DL2305N944DNMSPSFO916912-41392524922420715891052411251056-2900[null][null][null][null][null][null]Delta Air Lines Inc.
7720155155DL2305N944DNSFOMSP12301227-315124221823021115891813418081817900[null][null][null][null][null][null]Delta Air Lines Inc.
7820155155DL2306N968ATJFKTPA805759-64784618618413410051100311111103-800[null][null][null][null][null][null]Delta Air Lines Inc.
7920155155DL2307N989DLATLSAV19151910-51719276656342142001520212006-1500[null][null][null][null][null][null]Delta Air Lines Inc.
8020155155DL2308N585NWSEAMSP13001257-3211318195208182139918205181518251000[null][null][null][null][null][null]Delta Air Lines Inc.
8120155155DL2309N901DAATLSTL8188191148339692734848465854851-300[null][null][null][null][null][null]Delta Air Lines Inc.
8220155155DL2309N901DASTLATL9359405109509081654841155612051201-400[null][null][null][null][null][null]Delta Air Lines Inc.
8320155155DL2310N974DLATLDFW8508544119051391421277311012410091016700[null][null][null][null][null][null]Delta Air Lines Inc.
8420155155DL2310N974DLDFWATL1100110772211291331319673114051314131418500[null][null][null][null][null][null]Delta Air Lines Inc.
8520155155DL2311N915DEJFKMIA18451844-122190620616714110892127422112131-4000[null][null][null][null][null][null]Delta Air Lines Inc.
8620155155DL2312N976DLJFKDTW16301625-5151640140108865091806718501813-3700[null][null][null][null][null][null]Delta Air Lines Inc.
8720155155DL2313N333NBINDMSP13051306110131610489765031332313491335-1400[null][null][null][null][null][null]Delta Air Lines Inc.
8820155155DL2313N333NBMSPIND957100031510159387695031224312301227-300[null][null][null][null][null][null]Delta Air Lines Inc.
8920155155DL2314N582NWSEAMSP715712-31873019519417313991223312301226-400[null][null][null][null][null][null]Delta Air Lines Inc.
9020155155DL2315N3767CVGATL718716-21072691856537383110849841-800[null][null][null][null][null][null]Delta Air Lines Inc.
9120155155DL2316N397DADTWLAS845845018903262268240174910031010071013600[null][null][null][null][null][null]Delta Air Lines Inc.
9220155155DL2317N906DLPBILGA14211418-312143017316014010351650817141658-1600[null][null][null][null][null][null]Delta Air Lines Inc.
9320155155DL2318N337NBBZNMSP13281321-7913301331361248741634316411637-400[null][null][null][null][null][null]Delta Air Lines Inc.
9420155155DL2318N337NBMSPBZN11251122-31511371471371188741235412521239-1300[null][null][null][null][null][null]Delta Air Lines Inc.
9520155155DL2319N337NWLGAMSP10151010-517102719516214110201148412301152-3800[null][null][null][null][null][null]Delta Air Lines Inc.
9620155155DL2321N804DNMSPLAX19321937521195824123720915352127721332134100[null][null][null][null][null][null]Delta Air Lines Inc.
9720155155DL2322N943DNMIAMSP152515411621160223421819015011812718191819000[null][null][null][null][null][null]Delta Air Lines Inc.
9820155155DL2322N943DNMSPMIA10051003-217102021722219715011437814421445300[null][null][null][null][null][null]Delta Air Lines Inc.
9920155155DL2323N532USTPAATL520517-3115288580624066307645637-800[null][null][null][null][null][null]Delta Air Lines Inc.
10020155155DL2324N627DLSLCATL11511501312821521619515906438650651100[null][null][null][null][null][null]Delta Air Lines Inc.
Out[19]:
Rows: 1-100 of 5819079 | Columns: 32
In [2]:
sm_consumption = vDataFrame("public.sm_consumption")
sm_weather = vDataFrame("public.sm_weather")
display(sm_consumption)
display(sm_weather)
123
meterID
Int
📅
dateUTC
Timestamp
123
value
Numeric(10,6)
102014-01-01 11:00:000.029
202014-01-01 13:45:000.277
302014-01-02 10:45:000.321
402014-01-02 11:15:000.305
502014-01-02 13:45:000.358
602014-01-02 15:30:000.115
702014-01-03 08:30:000.071
802014-01-04 23:45:000.323
902014-01-06 01:15:000.085
1002014-01-06 21:45:000.713
1102014-01-07 00:15:000.242
1202014-01-07 23:00:000.09
1302014-01-09 05:30:000.115
1402014-01-09 15:00:000.928
1502014-01-09 18:15:001.09
1602014-01-10 10:00:000.07
1702014-01-10 14:30:0010.832
1802014-01-10 15:30:003.288
1902014-01-10 18:00:000.42
2002014-01-11 10:45:001.045
2102014-01-12 07:45:000.091
2202014-01-13 19:45:000.249
2302014-01-13 20:15:000.34
2402014-01-14 13:00:000.099
2502014-01-14 14:00:000.2
2602014-01-14 14:45:000.865
2702014-01-14 22:00:000.716
2802014-01-15 03:45:000.05
2902014-01-15 11:15:000.052
3002014-01-15 11:30:000.038
3102014-01-15 23:15:000.239
3202014-01-16 19:30:001.422
3302014-01-17 15:00:000.291
3402014-01-18 00:30:000.828
3502014-01-19 03:00:000.017
3602014-01-19 05:30:000.024
3702014-01-19 06:15:000.048
3802014-01-19 15:30:0013.3
3902014-01-20 19:30:000.59
4002014-01-21 12:30:000.327
4102014-01-21 13:30:000.108
4202014-01-22 01:30:000.083
4302014-01-22 04:30:000.044
4402014-01-23 21:00:000.226
4502014-01-24 02:00:000.125
4602014-01-24 12:15:000.168
4702014-01-27 22:45:000.495
4802014-01-28 06:15:000.056
4902014-01-28 11:30:000.113
5002014-01-28 19:00:001.566
5102014-01-28 19:45:001.108
5202014-01-29 05:00:000.064
5302014-01-29 07:45:000.145
5402014-01-29 13:00:001.719
5502014-01-30 06:15:000.059
5602014-01-30 17:45:000.575
5702014-01-30 18:45:001.129
5802014-02-01 03:30:000.057
5902014-02-01 03:45:000.059
6002014-02-02 08:45:000.186
6102014-02-04 03:45:000.045
6202014-02-04 12:00:000.187
6302014-02-04 16:00:000.313
6402014-02-04 18:45:000.912
6502014-02-05 06:45:000.018
6602014-02-05 17:15:000.112
6702014-02-06 15:15:0010.146
6802014-02-07 11:00:000.868
6902014-02-07 17:30:003.812
7002014-02-07 22:15:001.262
7102014-02-08 03:45:000.043
7202014-02-08 06:45:000.106
7302014-02-09 04:15:000.449
7402014-02-09 08:30:000.007
7502014-02-11 02:30:000.087
7602014-02-11 05:30:000.039
7702014-02-11 19:00:000.094
7802014-02-12 02:30:000.102
7902014-02-13 02:45:000.097
8002014-02-13 09:30:000.161
8102014-02-13 19:00:001.147
8202014-02-14 00:15:000.084
8302014-02-14 02:00:000.174
8402014-02-14 11:15:000.05
8502014-02-14 13:45:000.033
8602014-02-15 02:00:000.181
8702014-02-15 13:45:000.031
8802014-02-15 15:00:000.483
8902014-02-15 20:15:000.368
9002014-02-16 00:00:000.195
9102014-02-17 02:45:000.094
9202014-02-17 12:45:000.049
9302014-02-17 15:15:000.008
9402014-02-18 05:00:000.041
9502014-02-18 20:15:001.202
9602014-02-19 00:15:000.148
9702014-02-19 07:00:000.095
9802014-02-20 00:15:000.039
9902014-02-20 07:30:000.213
10002014-02-20 19:00:001.208
Rows: 1-100 | Columns: 3
📅
dateUTC
Timestamp
123
temperature
Numeric(10,6)
123
humidity
Numeric(11,6)
12014-01-01 00:00:0038.095.0
22014-01-01 00:30:0037.493.0
32014-01-01 01:00:0037.4100.0
42014-01-01 01:30:0037.4100.0
52014-01-01 02:00:0039.293.0
62014-01-01 02:30:0039.293.0
72014-01-01 03:00:0039.293.0
82014-01-01 03:30:0039.293.0
92014-01-01 04:00:0039.293.0
102014-01-01 04:30:0039.293.0
112014-01-01 05:00:0039.293.0
122014-01-01 05:30:0039.287.0
132014-01-01 06:00:0038.089.0
142014-01-01 06:30:0037.493.0
152014-01-01 07:00:0037.493.0
162014-01-01 07:30:0037.493.0
172014-01-01 08:00:0037.493.0
182014-01-01 08:30:0037.487.0
192014-01-01 09:00:0037.487.0
202014-01-01 09:30:0037.487.0
212014-01-01 10:00:0037.493.0
222014-01-01 10:30:0037.493.0
232014-01-01 11:00:0037.487.0
242014-01-01 11:30:0037.493.0
252014-01-01 12:00:0038.085.0
262014-01-01 12:30:0039.287.0
272014-01-01 13:00:0039.287.0
282014-01-01 13:30:0039.287.0
292014-01-01 14:00:0039.287.0
302014-01-01 14:30:0039.287.0
312014-01-01 15:00:0039.287.0
322014-01-01 15:30:0039.287.0
332014-01-01 16:00:0037.493.0
342014-01-01 16:30:0039.287.0
352014-01-01 17:00:0039.287.0
362014-01-01 17:30:0037.487.0
372014-01-01 18:00:0038.081.0
382014-01-01 18:30:0037.487.0
392014-01-01 19:00:0035.687.0
402014-01-01 19:30:0037.493.0
412014-01-01 20:00:0039.287.0
422014-01-01 20:30:0039.287.0
432014-01-01 21:00:0039.287.0
442014-01-01 21:30:0041.081.0
452014-01-01 22:00:0039.287.0
462014-01-01 22:30:0039.287.0
472014-01-01 23:00:0039.287.0
482014-01-01 23:30:0039.281.0
492014-01-02 00:00:0038.076.0
502014-01-02 00:30:0037.481.0
512014-01-02 01:00:0037.481.0
522014-01-02 01:30:0037.481.0
532014-01-02 02:00:0037.481.0
542014-01-02 02:30:0037.481.0
552014-01-02 03:00:0037.481.0
562014-01-02 03:30:0037.481.0
572014-01-02 04:00:0037.481.0
582014-01-02 04:30:0035.687.0
592014-01-02 05:00:0035.693.0
602014-01-02 05:30:0037.481.0
612014-01-02 06:00:0037.075.0
622014-01-02 06:30:0037.481.0
632014-01-02 07:00:0037.487.0
642014-01-02 07:30:0037.481.0
652014-01-02 08:00:0035.681.0
662014-01-02 08:30:0035.681.0
672014-01-02 09:00:0037.475.0
682014-01-02 09:30:0037.481.0
692014-01-02 10:00:0039.275.0
702014-01-02 10:30:0041.070.0
712014-01-02 11:00:0039.275.0
722014-01-02 11:30:0041.070.0
732014-01-02 12:00:0041.061.0
742014-01-02 12:30:0041.070.0
752014-01-02 13:00:0041.076.0
762014-01-02 13:30:0041.076.0
772014-01-02 14:00:0041.076.0
782014-01-02 14:30:0041.076.0
792014-01-02 15:00:0041.076.0
802014-01-02 15:30:0041.076.0
812014-01-02 16:00:0041.076.0
822014-01-02 16:30:0041.076.0
832014-01-02 17:00:0041.076.0
842014-01-02 17:30:0039.281.0
852014-01-02 18:00:0039.070.0
862014-01-02 18:30:0037.481.0
872014-01-02 19:00:0039.275.0
882014-01-02 19:30:0037.481.0
892014-01-02 20:00:0037.481.0
902014-01-02 20:30:0039.275.0
912014-01-02 21:00:0039.265.0
922014-01-02 21:30:0039.265.0
932014-01-02 22:00:0039.265.0
942014-01-02 22:30:0039.261.0
952014-01-02 23:00:0039.261.0
962014-01-02 23:30:0039.265.0
972014-01-03 00:00:0039.048.0
982014-01-03 00:30:0039.261.0
992014-01-03 01:00:0039.265.0
1002014-01-03 01:30:0037.470.0
Rows: 1-100 | Columns: 3
In [5]:
# Time Series Join with interpolation

sm_consumption.join(sm_weather,
                    on = [("dateUTC": "dateUTC", "linterpolate")],
                    how = "left",
                    expr1 = ["dateUTC AS dateUTC_sm", "meterID", "value"],
                    expr2 = ["*"])
Out[5]:
📅
dateUTC_sm
Timestamp
123
meterID
Int
123
value
Numeric(10,6)
📅
dateUTC
Timestamp
123
temperature
Numeric(10,6)
123
humidity
Numeric(11,6)
12014-01-01 00:00:009130.0972014-01-01 00:00:0038.095.0
22014-01-01 00:00:008950.1842014-01-01 00:00:0038.095.0
32014-01-01 00:00:007950.0932014-01-01 00:00:0038.095.0
42014-01-01 00:00:007800.1162014-01-01 00:00:0038.095.0
52014-01-01 00:00:007470.5592014-01-01 00:00:0038.095.0
62014-01-01 00:00:006600.8362014-01-01 00:00:0038.095.0
72014-01-01 00:00:006401.7962014-01-01 00:00:0038.095.0
82014-01-01 00:00:006050.0382014-01-01 00:00:0038.095.0
92014-01-01 00:00:004840.2112014-01-01 00:00:0038.095.0
102014-01-01 00:00:004740.3132014-01-01 00:00:0038.095.0
112014-01-01 00:00:004570.0222014-01-01 00:00:0038.095.0
122014-01-01 00:00:003710.8152014-01-01 00:00:0038.095.0
132014-01-01 00:00:003550.4482014-01-01 00:00:0038.095.0
142014-01-01 00:00:003480.0712014-01-01 00:00:0038.095.0
152014-01-01 00:00:003071.4232014-01-01 00:00:0038.095.0
162014-01-01 00:00:001880.1522014-01-01 00:00:0038.095.0
172014-01-01 00:00:001810.1382014-01-01 00:00:0038.095.0
182014-01-01 00:00:001790.0332014-01-01 00:00:0038.095.0
192014-01-01 00:00:001290.0542014-01-01 00:00:0038.095.0
202014-01-01 00:00:001160.2322014-01-01 00:00:0038.095.0
212014-01-01 00:15:009860.3012014-01-01 00:00:0038.095.0
222014-01-01 00:15:008480.1862014-01-01 00:00:0038.095.0
232014-01-01 00:15:008290.1452014-01-01 00:00:0038.095.0
242014-01-01 00:15:007180.0912014-01-01 00:00:0038.095.0
252014-01-01 00:15:006370.3192014-01-01 00:00:0038.095.0
262014-01-01 00:15:006250.1412014-01-01 00:00:0038.095.0
272014-01-01 00:15:006190.1032014-01-01 00:00:0038.095.0
282014-01-01 00:15:005834.0812014-01-01 00:00:0038.095.0
292014-01-01 00:15:004440.1312014-01-01 00:00:0038.095.0
302014-01-01 00:15:002210.3992014-01-01 00:00:0038.095.0
312014-01-01 00:15:00670.1572014-01-01 00:00:0038.095.0
322014-01-01 00:15:00520.1572014-01-01 00:00:0038.095.0
332014-01-01 00:30:009330.0612014-01-01 00:30:0037.493.0
342014-01-01 00:30:009300.2022014-01-01 00:30:0037.493.0
352014-01-01 00:30:009040.1592014-01-01 00:30:0037.493.0
362014-01-01 00:30:008290.0822014-01-01 00:30:0037.493.0
372014-01-01 00:30:007960.2372014-01-01 00:30:0037.493.0
382014-01-01 00:30:006630.082014-01-01 00:30:0037.493.0
392014-01-01 00:30:006281.2462014-01-01 00:30:0037.493.0
402014-01-01 00:30:006260.1062014-01-01 00:30:0037.493.0
412014-01-01 00:30:006180.0672014-01-01 00:30:0037.493.0
422014-01-01 00:30:005060.1082014-01-01 00:30:0037.493.0
432014-01-01 00:30:004970.1442014-01-01 00:30:0037.493.0
442014-01-01 00:30:004600.0942014-01-01 00:30:0037.493.0
452014-01-01 00:30:003760.1292014-01-01 00:30:0037.493.0
462014-01-01 00:30:003320.0442014-01-01 00:30:0037.493.0
472014-01-01 00:30:003080.0452014-01-01 00:30:0037.493.0
482014-01-01 00:30:002860.2092014-01-01 00:30:0037.493.0
492014-01-01 00:30:002770.2872014-01-01 00:30:0037.493.0
502014-01-01 00:30:002640.1622014-01-01 00:30:0037.493.0
512014-01-01 00:30:001382.2762014-01-01 00:30:0037.493.0
522014-01-01 00:30:00900.1832014-01-01 00:30:0037.493.0
532014-01-01 00:45:009770.1762014-01-01 00:30:0037.493.0
542014-01-01 00:45:009370.2012014-01-01 00:30:0037.493.0
552014-01-01 00:45:009270.5512014-01-01 00:30:0037.493.0
562014-01-01 00:45:008670.8442014-01-01 00:30:0037.493.0
572014-01-01 00:45:007620.132014-01-01 00:30:0037.493.0
582014-01-01 00:45:005280.0672014-01-01 00:30:0037.493.0
592014-01-01 00:45:004470.5992014-01-01 00:30:0037.493.0
602014-01-01 00:45:003750.5192014-01-01 00:30:0037.493.0
612014-01-01 00:45:002970.6092014-01-01 00:30:0037.493.0
622014-01-01 00:45:002500.4282014-01-01 00:30:0037.493.0
632014-01-01 00:45:002350.062014-01-01 00:30:0037.493.0
642014-01-01 01:00:009800.162014-01-01 01:00:0037.4100.0
652014-01-01 01:00:007970.1142014-01-01 01:00:0037.4100.0
662014-01-01 01:00:007830.0252014-01-01 01:00:0037.4100.0
672014-01-01 01:00:007090.0582014-01-01 01:00:0037.4100.0
682014-01-01 01:00:006970.1842014-01-01 01:00:0037.4100.0
692014-01-01 01:00:006360.1392014-01-01 01:00:0037.4100.0
702014-01-01 01:00:005480.3092014-01-01 01:00:0037.4100.0
712014-01-01 01:00:003740.1042014-01-01 01:00:0037.4100.0
722014-01-01 01:00:003580.4712014-01-01 01:00:0037.4100.0
732014-01-01 01:00:003040.1092014-01-01 01:00:0037.4100.0
742014-01-01 01:00:002910.4122014-01-01 01:00:0037.4100.0
752014-01-01 01:00:002630.1722014-01-01 01:00:0037.4100.0
762014-01-01 01:00:002560.1242014-01-01 01:00:0037.4100.0
772014-01-01 01:00:001230.3092014-01-01 01:00:0037.4100.0
782014-01-01 01:00:00790.2432014-01-01 01:00:0037.4100.0
792014-01-01 01:00:00750.2742014-01-01 01:00:0037.4100.0
802014-01-01 01:00:00610.12014-01-01 01:00:0037.4100.0
812014-01-01 01:00:00350.1342014-01-01 01:00:0037.4100.0
822014-01-01 01:15:009500.1272014-01-01 01:00:0037.4100.0
832014-01-01 01:15:008440.5392014-01-01 01:00:0037.4100.0
842014-01-01 01:15:008320.3582014-01-01 01:00:0037.4100.0
852014-01-01 01:15:008070.0952014-01-01 01:00:0037.4100.0
862014-01-01 01:15:006560.1042014-01-01 01:00:0037.4100.0
872014-01-01 01:15:005980.182014-01-01 01:00:0037.4100.0
882014-01-01 01:15:005880.0642014-01-01 01:00:0037.4100.0
892014-01-01 01:15:005700.0182014-01-01 01:00:0037.4100.0
902014-01-01 01:15:004760.2992014-01-01 01:00:0037.4100.0
912014-01-01 01:15:004670.2922014-01-01 01:00:0037.4100.0
922014-01-01 01:15:003860.1562014-01-01 01:00:0037.4100.0
932014-01-01 01:15:003060.162014-01-01 01:00:0037.4100.0
942014-01-01 01:15:002900.0922014-01-01 01:00:0037.4100.0
952014-01-01 01:15:001930.1012014-01-01 01:00:0037.4100.0
962014-01-01 01:15:001340.4292014-01-01 01:00:0037.4100.0
972014-01-01 01:15:001230.4462014-01-01 01:00:0037.4100.0
982014-01-01 01:15:001190.2682014-01-01 01:00:0037.4100.0
992014-01-01 01:15:00890.1072014-01-01 01:00:0037.4100.0
1002014-01-01 01:15:0020.0372014-01-01 01:00:0037.4100.0
Rows: 1-100 | Columns: 6

See Also

vDataFrame.append Merges the vDataFrame with another relation.
vDataFrame.groupby Aggregates the vDataFrame.
vDataFrame.sort Sorts the vDataFrame.