Loading...

verticapy.machine_learning.vertica.preprocessing.balance

verticapy.machine_learning.vertica.preprocessing.balance(name: str, input_relation: str, y: str, method: Literal['hybrid', 'over', 'under'] = 'hybrid', ratio: float = 0.5) → vDataFrame

Creates a view with an equal distribution of the input data based on the response_column.

Parameters

name: str

Name of the view.

input_relation: str

Relation used to create the new relation.

y: str

Response column.

method: str, optional

Method used to do the balancing.

  • hybrid:

    Performs over-sampling and under-sampling on different classes so that each class is equally represented.

  • over:

    Over-samples on all classes, except the most represented class, towards the most represented class’s cardinality.

  • under:

    Under-samples on all classes, except the least represented class, towards the least represented class’s cardinality.

ratio: float, optional

The desired ratio between the majority class and the minority class. This value has no effect when used with the ‘hybrid’ balance method.

Returns

vDataFrame

vDataFrame of the created view.

Examples

The following examples provide a basic understanding of usage. For more detailed examples, please refer to the Machine Learning or the Examples section on the website.

Load data for machine learning

We import verticapy:

import verticapy as vp

Hint

By assigning an alias to verticapy, we mitigate the risk of code collisions with other libraries. This precaution is necessary because verticapy uses commonly known function names like “average” and “median”, which can potentially lead to naming conflicts. The use of an alias ensures that the functions from verticapy are used as intended without interfering with functions from other libraries.

For this example, we will use the Titanic dataset.

import verticapy.datasets as vpd

data = vpd.load_titanic()
123
pclass
Integer
123
survived
Integer
Abc
Varchar(164)
Abc
sex
Varchar(20)
123
age
Numeric(8)
123
sibsp
Integer
123
parch
Integer
Abc
ticket
Varchar(36)
123
fare
Numeric(12)
Abc
cabin
Varchar(30)
Abc
embarked
Varchar(20)
Abc
boat
Varchar(100)
123
body
Integer
Abc
Varchar(100)
110male71.000PC 1760949.5042[null]C[null]22
210male45.00011378435.5TS[null][null]
310male[null]0011379831.0[null]S[null][null]
410male17.00011305947.1[null]S[null][null]
510male27.01013508136.7792C89C[null][null]
610male37.011PC 1775683.1583E52C[null][null]
710male31.010F.C. 1275052.0B71S[null][null]
810male50.010PC 17761106.425C86C[null]62
910female36.000PC 1753131.6792A29C[null][null]
1010male37.01011380353.1C123S[null][null]
1110male24.000PC 1759379.2B86C[null][null]
1210male45.0103697383.475C83S[null][null]
1310male40.0001120590.0B94S[null]110
1410male42.00011303842.5B11S[null][null]
1510male[null]001746351.8625E46S[null][null]
1610male42.01011378952.0[null]S[null]38
1710male[null]00PC 1760030.6958[null]C14[null]
1810male29.00011350130.0D6S[null]126
1910male46.0001305075.2417C6C[null]292
2010male54.0001746351.8625E46S[null]175
2110male47.00011379642.4[null]S[null][null]
2210male58.00235273113.275D48C[null]122
2310male45.50011304328.5C124S[null]166
2410male29.01011377666.6C2S[null][null]
2510male47.00011046552.0C110S[null]207
2610male38.000199720.0[null]S[null][null]
2710male22.000PC 17760135.6333[null]C[null]232
2810male31.000PC 1759050.4958A24S[null][null]
2910male50.0101350755.9E44S[null][null]
3010male56.0001776430.6958A7C[null][null]
3110male57.010PC 17569146.5208B78C[null][null]
3210female63.010PC 17483221.7792C55 C57S[null][null]
3310male61.0003696332.3208D50S[null]46
3410male21.0013528177.2875D26S[null]169
3510male51.001PC 1759761.3792[null]C[null][null]
3611female63.0101350277.9583D7S10[null]
3711female32.0001181376.2917D15C8[null]
3811female58.00011378326.55C103S8[null]
3911female44.000PC 1761027.7208B4C6[null]
4011female41.00016966134.5E40C3[null]
4111female53.000PC 1760627.4458[null]C6[null]
4211male36.001PC 17755512.3292B51 B53 B55C3[null]
4311female58.001PC 17755512.3292B51 B53 B55C3[null]
4411male11.012113760120.0B96 B98S4[null]
4511female76.0101987778.85C46S6[null]
4611female[null]0111350555.0E33S6[null]
4711female39.011PC 1775683.1583E49C14[null]
4811female27.012F.C. 1275052.0B71S3[null]
4911female[null]0017421110.8833[null]C4[null]
5011female35.000113503211.5C130C4[null]
5111female22.00111237859.4[null]C7[null]
5211female25.0101176555.4417E50C5[null]
5311male48.010PC 1757276.7292D33C3[null]
5411female35.0103697383.475C83SD[null]
5511male27.000PC 1757276.7292D49C3[null]
5611female24.0001176783.1583C54C7[null]
5711female52.0111274993.5B69S3[null]
5811female44.00111136157.9792B18C4[null]
5911female15.00124160211.3375B5S2[null]
6011male30.0101323657.75C78C11[null]
6111female31.01035273113.275D36C6[null]
6211female39.000PC 17758108.9C105C8[null]
6311female22.00111350961.9792B36C5[null]
6411male52.00011378630.5C104S6[null]
6511female43.00124160211.3375B3S2[null]
6611female33.00011015286.5B77S8[null]
6711male45.01116966134.5E34C3[null]
6811female40.01116966134.5E34C3[null]
6911male48.0101999652.0C126S5 7[null]
7011female[null]00PC 1758579.2[null]CD[null]
7111female35.000PC 17755512.3292[null]C3[null]
7211female60.01011081375.25D37C5[null]
7311male21.001PC 1759761.3792[null]CA[null]
7420male23.000C.A. 3103010.5[null]S[null][null]
7520male28.00024435826.0[null]S[null][null]
7620male60.0112975039.0[null]S[null][null]
7720female44.01024425226.0[null]S[null][null]
7820male29.010200326.0[null]S[null][null]
7920male18.000S.O.C. 1487973.5[null]S[null][null]
8020male18.000S.O.C. 1487973.5[null]S[null][null]
8120male54.0002840326.0[null]S[null][null]
8220male18.00023617113.0[null]S[null][null]
8320male36.00022923613.0[null]S[null]236
8420male34.0102866421.0[null]S[null][null]
8520male21.0102813311.5[null]S[null][null]
8620male21.0102813411.5[null]S[null][null]
8720male24.00023386613.0[null]S[null]155
8820male34.0001223313.0[null]S[null][null]
8920male30.00025065313.0[null]S[null]75
9020male44.00024874613.0[null]S[null]35
9120male49.01222084565.0[null]S[null][null]
9220male21.020S.O.C. 1487973.5[null]S[null][null]
9320male21.000S.O.C. 1487973.5[null]S[null][null]
9420female60.0102406526.0[null]S[null][null]
9520male24.020C.A. 3102931.5[null]S[null][null]
9620male22.020C.A. 3102931.5[null]S[null][null]
9720male35.00023373412.35[null]Q[null][null]
9820male31.000C.A. 1872310.5[null]S[null]165
9920male36.000SC/Paris 216312.875DC[null][null]
10020male[null]00SC/A.3 286115.5792[null]C[null][null]
Rows: 1-100 | Columns: 14

Note

VerticaPy offers a wide range of sample datasets that are ideal for training and testing purposes. You can explore the full list of available datasets in the Datasets, which provides detailed information on each dataset and how to use them effectively. These datasets are invaluable resources for honing your data analysis and machine learning skills within the VerticaPy environment.

Function Application

First we import the balance function:

from verticapy.machine_learning.vertica import balance

Then we can directly apply it to the dataset:

balance(
    name = "balance_model",
    input_relation = data,
    y = "survived",
    method = "under",
)
123
pclass
Integer
123
survived
Integer
Abc
Varchar(164)
Abc
sex
Varchar(20)
123
age
Numeric(8)
123
sibsp
Integer
123
parch
Integer
Abc
ticket
Varchar(36)
123
fare
Numeric(12)
Abc
cabin
Varchar(30)
Abc
embarked
Varchar(20)
Abc
boat
Varchar(100)
123
body
Integer
Abc
Varchar(100)
110male47.010PC 17757227.525C62 C64C[null]124
210male[null]00PC 1731825.925[null]S[null][null]
310male24.001PC 17558247.5208B58 B60C[null][null]
410male25.0001390526.0[null]C[null]148
510male42.00011048926.55D22S[null][null]
610male45.00011305026.55B38S[null][null]
710male46.010W.E.P. 573461.175E31S[null][null]
810male[null]0011379126.55[null]S[null][null]
910male39.000PC 1758029.7A18C[null]133
1010male64.01419950263.0C23 C25 C27S[null][null]
1110male[null]0011377826.55D34S[null][null]
1210male71.000PC 1775434.6542A5C[null][null]
1310male[null]0011379642.4[null]S[null][null]
1410male32.500113503211.5C132C[null]45
1510male41.0101746451.8625D21S[null][null]
1610male[null]0011302826.55C124S[null][null]
1710male28.010PC 1760482.1708[null]C[null][null]
1810male55.00011378730.5C30S[null][null]
1910male37.001PC 1759629.7C118C[null][null]
2010male64.00069326.0[null]S[null]263
2110male28.500PC 1756227.7208D43C[null]189
2210male[null]00PC 17757227.525[null]C[null][null]
2310male56.00011379226.55[null]S[null][null]
2410male24.0101369560.0C31S[null][null]
2510male49.01117421110.8833C68C[null][null]
2610male47.0003696734.0208D46S[null][null]
2710male64.01011081375.25D37C[null][null]
2811male0.9212113781151.55C22 C26S11[null]
2911female53.0201176951.4792C101SD[null]
3011female18.010PC 17757227.525C62 C64C4[null]
3111male80.0002704230.0A23SB[null]
3211male37.0111175152.5542D35S5[null]
3311male26.00011136930.0C148C5[null]
3411female42.000PC 17757227.525[null]C4[null]
3511male25.0101196791.0792B49C7[null]
3611female35.000PC 17760135.6333C99S8[null]
3711female45.000PC 17608262.375[null]C4[null]
3811female22.00111350555.0E33S6[null]
3911female60.0001181376.2917D15C8[null]
4011female14.012113760120.0B96 B98S4[null]
4111female[null]001777027.7208[null]C5[null]
4211male45.000PC 1759429.7A9C7[null]
4311female22.000113781151.55[null]S11[null]
4411female64.002PC 1775683.1583E45C14[null]
4511female36.002WE/P 573571.0B22S7[null]
4611female27.011PC 17558247.5208B58 B60C6[null]
4711female54.0103694778.2667D20C4[null]
4811male43.0101776527.7208D40C5[null]
4911female22.0021356849.5B39C5[null]
5011female35.01011380353.1C123SD[null]
5111male53.00011378028.5C51CB[null]
5211female19.00011205330.0B42S3[null]
5311female58.001PC 17582153.4625C125S3[null]
5411male23.001PC 1775963.3583D10 D12C7[null]
5511male25.0101176555.4417E50C5[null]
5611male[null]001698830.0D45S3[null]
5711female35.01011378952.0[null]S8[null]
5811female[null]101746451.8625D21S8[null]
5911male42.0101175352.5542D19S5[null]
6011female45.0101175352.5542D19S5[null]
6111female39.00024160211.3375[null]S2[null]
6211female16.001PC 1759239.4D28S9[null]
6311female21.0001350277.9583D9S10[null]
6411female18.01011377353.1D30S10[null]
6511male36.000PC 1747326.2875E25S7[null]
6611female37.0101992890.0C78Q14[null]
6711male[null]00F.C. 1299825.7417[null]C7[null]
6811female22.01011377666.6C2S8[null]
6911female30.0001274993.5B73S3[null]
7011female33.000PC 1761327.7208A11C11[null]
7111female54.010PC 1760359.4[null]C6[null]
7211female18.022PC 17608262.375B57 B59 B63 B66C4[null]
7311female48.013PC 17608262.375B57 B59 B63 B66C4[null]
7411male35.000PC 1747526.2875E24S5[null]
7511female23.0102122882.2667B45S7[null]
7611female43.0101177855.4417C116C5[null]
7711female39.01111041379.65E67S8[null]
7811female39.01117421110.8833C68C4[null]
7911female55.000PC 17760135.6333C32C8[null]
8011female31.00236928164.8667C7S8[null]
8120male30.010P/PP 338124.0[null]C[null][null]
8220male30.00024874413.0[null]S[null][null]
8320male57.00024434613.0[null]S[null][null]
8420male51.000S.O.P. 116612.525[null]S[null]174
8520male[null]002398530.0[null]S[null][null]
8620male52.00024873113.5[null]S[null]130
8720male37.010SC/AH 2903726.0[null]S[null]17
8820female29.010SC/AH 2903726.0[null]S[null][null]
8920male29.000W./C. 1426310.5[null]S[null][null]
9020female30.00023724913.0[null]S[null][null]
9120male[null]002398530.0[null]S[null][null]
9220male17.000S.O.C. 1487973.5[null]S[null][null]
9320male18.000C.A. 1518510.5[null]S[null][null]
9420male24.00024872613.5[null]S[null]297
9520male30.00025064613.0[null]S[null]305
9620male52.00025064713.0[null]S[null]19
9720female18.01125065013.0[null]S[null][null]
9820male23.0212910411.5[null]S[null][null]
9920male36.00024296313.0[null]S[null][null]
10020male44.0102670726.0[null]S[null][null]
Rows: 1-100 | Columns: 14

See also

vDataFrame.sample() : Sampling the dataset.