Dataset statistics
Number of variables | 10 |
---|---|
Number of observations | 77096 |
Missing cells | 168060 |
Missing cells (%) | 21.8% |
Duplicate rows | 0 |
Duplicate rows (%) | 0.0% |
Total size in memory | 5.9 MiB |
Average record size in memory | 80.0 B |
Variable types
Numeric | 10 |
---|
review_scores_rating is highly overall correlated with review_scores_comfort and 5 other fields | High correlation |
review_scores_comfort is highly overall correlated with review_scores_rating and 5 other fields | High correlation |
review_scores_amenities is highly overall correlated with review_scores_rating and 4 other fields | High correlation |
review_scores_trip is highly overall correlated with review_scores_rating and 4 other fields | High correlation |
review_scores_crew is highly overall correlated with review_scores_rating and 5 other fields | High correlation |
review_scores_price is highly overall correlated with review_scores_rating and 5 other fields | High correlation |
number_of_reviews is highly overall correlated with reviews_per_month | High correlation |
reviews_per_month is highly overall correlated with number_of_reviews | High correlation |
review_scores_location is highly overall correlated with review_scores_rating and 3 other fields | High correlation |
review_scores_rating has 21140 (27.4%) missing values | Missing |
review_scores_comfort has 21200 (27.5%) missing values | Missing |
review_scores_amenities has 21187 (27.5%) missing values | Missing |
review_scores_trip has 21263 (27.6%) missing values | Missing |
review_scores_crew has 21194 (27.5%) missing values | Missing |
review_scores_location has 21265 (27.6%) missing values | Missing |
review_scores_price has 21268 (27.6%) missing values | Missing |
reviews_per_month has 19543 (25.3%) missing values | Missing |
shuttle_id is uniformly distributed | Uniform |
shuttle_id has unique values | Unique |
number_of_reviews has 19400 (25.2%) zeros | Zeros |
Reproduction
Analysis started | 2022-11-24 10:38:24.288959 |
---|---|
Analysis finished | 2022-11-24 10:38:47.073557 |
Duration | 22.78 seconds |
Software version | pandas-profiling vv3.5.0 |
Download configuration | config.json |
Distinct | 77096 |
---|---|
Distinct (%) | 100.0% |
Missing | 0 |
Missing (%) | 0.0% |
Infinite | 0 |
Infinite (%) | 0.0% |
Mean | 38548.5 |
Minimum | 1 |
---|---|
Maximum | 77096 |
Zeros | 0 |
Zeros (%) | 0.0% |
Negative | 0 |
Negative (%) | 0.0% |
Memory size | 602.4 KiB |
Quantile statistics
Minimum | 1 |
---|---|
5-th percentile | 3855.75 |
Q1 | 19274.75 |
median | 38548.5 |
Q3 | 57822.25 |
95-th percentile | 73241.25 |
Maximum | 77096 |
Range | 77095 |
Interquartile range (IQR) | 38547.5 |
Descriptive statistics
Standard deviation | 22255.843 |
---|---|
Coefficient of variation (CV) | 0.57734652 |
Kurtosis | -1.2 |
Mean | 38548.5 |
Median Absolute Deviation (MAD) | 19274 |
Skewness | 1.7649979 × 10-18 |
Sum | 2.9719352 × 109 |
Variance | 4.9532253 × 108 |
Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
Value | Count | Frequency (%) |
63561 | 1 | < 0.1% |
25124 | 1 | < 0.1% |
44449 | 1 | < 0.1% |
4748 | 1 | < 0.1% |
30795 | 1 | < 0.1% |
8614 | 1 | < 0.1% |
62491 | 1 | < 0.1% |
40429 | 1 | < 0.1% |
20507 | 1 | < 0.1% |
24295 | 1 | < 0.1% |
Other values (77086) | 77086 |
Value | Count | Frequency (%) |
1 | 1 | |
2 | 1 | |
3 | 1 | |
4 | 1 | |
5 | 1 | |
6 | 1 | |
7 | 1 | |
8 | 1 | |
9 | 1 | |
10 | 1 |
Value | Count | Frequency (%) |
77096 | 1 | |
77095 | 1 | |
77094 | 1 | |
77093 | 1 | |
77092 | 1 | |
77091 | 1 | |
77090 | 1 | |
77089 | 1 | |
77088 | 1 | |
77087 | 1 |
Distinct | 55 |
---|---|
Distinct (%) | 0.1% |
Missing | 21140 |
Missing (%) | 27.4% |
Infinite | 0 |
Infinite (%) | 0.0% |
Mean | 92.760473 |
Minimum | 20 |
---|---|
Maximum | 100 |
Zeros | 0 |
Zeros (%) | 0.0% |
Negative | 0 |
Negative (%) | 0.0% |
Memory size | 602.4 KiB |
Quantile statistics
Minimum | 20 |
---|---|
5-th percentile | 78 |
Q1 | 90 |
median | 96 |
Q3 | 100 |
95-th percentile | 100 |
Maximum | 100 |
Range | 80 |
Interquartile range (IQR) | 10 |
Descriptive statistics
Standard deviation | 9.7597506 |
---|---|
Coefficient of variation (CV) | 0.10521454 |
Kurtosis | 15.005726 |
Mean | 92.760473 |
Median Absolute Deviation (MAD) | 4 |
Skewness | -3.0846607 |
Sum | 5190505 |
Variance | 95.252732 |
Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
Value | Count | Frequency (%) |
100 | 16274 | |
98 | 3536 | 4.6% |
97 | 3341 | 4.3% |
93 | 3291 | 4.3% |
96 | 3278 | 4.3% |
90 | 3064 | 4.0% |
95 | 3042 | 3.9% |
80 | 2981 | 3.9% |
94 | 2080 | 2.7% |
99 | 2034 | 2.6% |
Other values (45) | 13035 | |
(Missing) | 21140 |
Value | Count | Frequency (%) |
20 | 212 | |
27 | 1 | < 0.1% |
30 | 6 | < 0.1% |
33 | 1 | < 0.1% |
40 | 176 | |
45 | 1 | < 0.1% |
47 | 14 | < 0.1% |
48 | 2 | < 0.1% |
50 | 74 | 0.1% |
52 | 3 | < 0.1% |
Value | Count | Frequency (%) |
100 | 16274 | |
99 | 2034 | 2.6% |
98 | 3536 | 4.6% |
97 | 3341 | 4.3% |
96 | 3278 | 4.3% |
95 | 3042 | 3.9% |
94 | 2080 | 2.7% |
93 | 3291 | 4.3% |
92 | 1702 | 2.2% |
91 | 1502 | 1.9% |
Distinct | 9 |
---|---|
Distinct (%) | < 0.1% |
Missing | 21200 |
Missing (%) | 27.5% |
Infinite | 0 |
Infinite (%) | 0.0% |
Mean | 9.517461 |
Minimum | 2 |
---|---|
Maximum | 10 |
Zeros | 0 |
Zeros (%) | 0.0% |
Negative | 0 |
Negative (%) | 0.0% |
Memory size | 602.4 KiB |
Quantile statistics
Minimum | 2 |
---|---|
5-th percentile | 8 |
Q1 | 9 |
median | 10 |
Q3 | 10 |
95-th percentile | 10 |
Maximum | 10 |
Range | 8 |
Interquartile range (IQR) | 1 |
Descriptive statistics
Standard deviation | 0.95591115 |
---|---|
Coefficient of variation (CV) | 0.10043762 |
Kurtosis | 19.913285 |
Mean | 9.517461 |
Median Absolute Deviation (MAD) | 0 |
Skewness | -3.6651314 |
Sum | 531988 |
Variance | 0.91376613 |
Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=9)
Value | Count | Frequency (%) |
10 | 38081 | |
9 | 12759 | 16.5% |
8 | 3348 | 4.3% |
7 | 648 | 0.8% |
6 | 586 | 0.8% |
2 | 236 | 0.3% |
4 | 135 | 0.2% |
5 | 95 | 0.1% |
3 | 8 | < 0.1% |
(Missing) | 21200 |
Value | Count | Frequency (%) |
2 | 236 | 0.3% |
3 | 8 | < 0.1% |
4 | 135 | 0.2% |
5 | 95 | 0.1% |
6 | 586 | 0.8% |
7 | 648 | 0.8% |
8 | 3348 | 4.3% |
9 | 12759 | 16.5% |
10 | 38081 |
Value | Count | Frequency (%) |
10 | 38081 | |
9 | 12759 | 16.5% |
8 | 3348 | 4.3% |
7 | 648 | 0.8% |
6 | 586 | 0.8% |
5 | 95 | 0.1% |
4 | 135 | 0.2% |
3 | 8 | < 0.1% |
2 | 236 | 0.3% |
Distinct | 9 |
---|---|
Distinct (%) | < 0.1% |
Missing | 21187 |
Missing (%) | 27.5% |
Infinite | 0 |
Infinite (%) | 0.0% |
Mean | 9.2805094 |
Minimum | 2 |
---|---|
Maximum | 10 |
Zeros | 0 |
Zeros (%) | 0.0% |
Negative | 0 |
Negative (%) | 0.0% |
Memory size | 602.4 KiB |
Quantile statistics
Minimum | 2 |
---|---|
5-th percentile | 7 |
Q1 | 9 |
median | 10 |
Q3 | 10 |
95-th percentile | 10 |
Maximum | 10 |
Range | 8 |
Interquartile range (IQR) | 1 |
Descriptive statistics
Standard deviation | 1.1220804 |
---|---|
Coefficient of variation (CV) | 0.1209072 |
Kurtosis | 10.852266 |
Mean | 9.2805094 |
Median Absolute Deviation (MAD) | 0 |
Skewness | -2.7028513 |
Sum | 518864 |
Variance | 1.2590644 |
Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=9)
Value | Count | Frequency (%) |
10 | 31261 | |
9 | 15734 | |
8 | 5785 | 7.5% |
7 | 1427 | 1.9% |
6 | 979 | 1.3% |
2 | 272 | 0.4% |
4 | 258 | 0.3% |
5 | 175 | 0.2% |
3 | 18 | < 0.1% |
(Missing) | 21187 |
Value | Count | Frequency (%) |
2 | 272 | 0.4% |
3 | 18 | < 0.1% |
4 | 258 | 0.3% |
5 | 175 | 0.2% |
6 | 979 | 1.3% |
7 | 1427 | 1.9% |
8 | 5785 | 7.5% |
9 | 15734 | |
10 | 31261 |
Value | Count | Frequency (%) |
10 | 31261 | |
9 | 15734 | |
8 | 5785 | 7.5% |
7 | 1427 | 1.9% |
6 | 979 | 1.3% |
5 | 175 | 0.2% |
4 | 258 | 0.3% |
3 | 18 | < 0.1% |
2 | 272 | 0.4% |
Distinct | 9 |
---|---|
Distinct (%) | < 0.1% |
Missing | 21263 |
Missing (%) | 27.6% |
Infinite | 0 |
Infinite (%) | 0.0% |
Mean | 9.6399441 |
Minimum | 2 |
---|---|
Maximum | 10 |
Zeros | 0 |
Zeros (%) | 0.0% |
Negative | 0 |
Negative (%) | 0.0% |
Memory size | 602.4 KiB |
Quantile statistics
Minimum | 2 |
---|---|
5-th percentile | 8 |
Q1 | 10 |
median | 10 |
Q3 | 10 |
95-th percentile | 10 |
Maximum | 10 |
Range | 8 |
Interquartile range (IQR) | 0 |
Descriptive statistics
Standard deviation | 0.86514388 |
---|---|
Coefficient of variation (CV) | 0.089745736 |
Kurtosis | 26.937725 |
Mean | 9.6399441 |
Median Absolute Deviation (MAD) | 0 |
Skewness | -4.3361867 |
Sum | 538227 |
Variance | 0.74847393 |
Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=9)
Value | Count | Frequency (%) |
10 | 42622 | |
9 | 9604 | 12.5% |
8 | 2241 | 2.9% |
7 | 532 | 0.7% |
6 | 451 | 0.6% |
2 | 191 | 0.2% |
4 | 117 | 0.2% |
5 | 69 | 0.1% |
3 | 6 | < 0.1% |
(Missing) | 21263 |
Value | Count | Frequency (%) |
2 | 191 | 0.2% |
3 | 6 | < 0.1% |
4 | 117 | 0.2% |
5 | 69 | 0.1% |
6 | 451 | 0.6% |
7 | 532 | 0.7% |
8 | 2241 | 2.9% |
9 | 9604 | 12.5% |
10 | 42622 |
Value | Count | Frequency (%) |
10 | 42622 | |
9 | 9604 | 12.5% |
8 | 2241 | 2.9% |
7 | 532 | 0.7% |
6 | 451 | 0.6% |
5 | 69 | 0.1% |
4 | 117 | 0.2% |
3 | 6 | < 0.1% |
2 | 191 | 0.2% |
Distinct | 9 |
---|---|
Distinct (%) | < 0.1% |
Missing | 21194 |
Missing (%) | 27.5% |
Infinite | 0 |
Infinite (%) | 0.0% |
Mean | 9.6748775 |
Minimum | 2 |
---|---|
Maximum | 10 |
Zeros | 0 |
Zeros (%) | 0.0% |
Negative | 0 |
Negative (%) | 0.0% |
Memory size | 602.4 KiB |
Quantile statistics
Minimum | 2 |
---|---|
5-th percentile | 8 |
Q1 | 10 |
median | 10 |
Q3 | 10 |
95-th percentile | 10 |
Maximum | 10 |
Range | 8 |
Interquartile range (IQR) | 0 |
Descriptive statistics
Standard deviation | 0.84564741 |
---|---|
Coefficient of variation (CV) | 0.087406525 |
Kurtosis | 30.450189 |
Mean | 9.6748775 |
Median Absolute Deviation (MAD) | 0 |
Skewness | -4.6564075 |
Sum | 540845 |
Variance | 0.71511955 |
Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=9)
Value | Count | Frequency (%) |
10 | 44179 | |
9 | 8405 | 10.9% |
8 | 2060 | 2.7% |
7 | 466 | 0.6% |
6 | 419 | 0.5% |
2 | 197 | 0.3% |
4 | 106 | 0.1% |
5 | 63 | 0.1% |
3 | 7 | < 0.1% |
(Missing) | 21194 |
Value | Count | Frequency (%) |
2 | 197 | 0.3% |
3 | 7 | < 0.1% |
4 | 106 | 0.1% |
5 | 63 | 0.1% |
6 | 419 | 0.5% |
7 | 466 | 0.6% |
8 | 2060 | 2.7% |
9 | 8405 | 10.9% |
10 | 44179 |
Value | Count | Frequency (%) |
10 | 44179 | |
9 | 8405 | 10.9% |
8 | 2060 | 2.7% |
7 | 466 | 0.6% |
6 | 419 | 0.5% |
5 | 63 | 0.1% |
4 | 106 | 0.1% |
3 | 7 | < 0.1% |
2 | 197 | 0.3% |
Distinct | 8 |
---|---|
Distinct (%) | < 0.1% |
Missing | 21265 |
Missing (%) | 27.6% |
Infinite | 0 |
Infinite (%) | 0.0% |
Mean | 9.4703122 |
Minimum | 2 |
---|---|
Maximum | 10 |
Zeros | 0 |
Zeros (%) | 0.0% |
Negative | 0 |
Negative (%) | 0.0% |
Memory size | 602.4 KiB |
Quantile statistics
Minimum | 2 |
---|---|
5-th percentile | 8 |
Q1 | 9 |
median | 10 |
Q3 | 10 |
95-th percentile | 10 |
Maximum | 10 |
Range | 8 |
Interquartile range (IQR) | 1 |
Descriptive statistics
Standard deviation | 0.83945496 |
---|---|
Coefficient of variation (CV) | 0.088640685 |
Kurtosis | 15.713622 |
Mean | 9.4703122 |
Median Absolute Deviation (MAD) | 0 |
Skewness | -2.911843 |
Sum | 528737 |
Variance | 0.70468462 |
Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=8)
Value | Count | Frequency (%) |
10 | 33853 | |
9 | 16873 | |
8 | 3931 | 5.1% |
6 | 481 | 0.6% |
7 | 472 | 0.6% |
2 | 103 | 0.1% |
4 | 84 | 0.1% |
5 | 34 | < 0.1% |
(Missing) | 21265 |
Value | Count | Frequency (%) |
2 | 103 | 0.1% |
4 | 84 | 0.1% |
5 | 34 | < 0.1% |
6 | 481 | 0.6% |
7 | 472 | 0.6% |
8 | 3931 | 5.1% |
9 | 16873 | |
10 | 33853 |
Value | Count | Frequency (%) |
10 | 33853 | |
9 | 16873 | |
8 | 3931 | 5.1% |
7 | 472 | 0.6% |
6 | 481 | 0.6% |
5 | 34 | < 0.1% |
4 | 84 | 0.1% |
2 | 103 | 0.1% |
Distinct | 9 |
---|---|
Distinct (%) | < 0.1% |
Missing | 21268 |
Missing (%) | 27.6% |
Infinite | 0 |
Infinite (%) | 0.0% |
Mean | 9.2836928 |
Minimum | 2 |
---|---|
Maximum | 10 |
Zeros | 0 |
Zeros (%) | 0.0% |
Negative | 0 |
Negative (%) | 0.0% |
Memory size | 602.4 KiB |
Quantile statistics
Minimum | 2 |
---|---|
5-th percentile | 8 |
Q1 | 9 |
median | 10 |
Q3 | 10 |
95-th percentile | 10 |
Maximum | 10 |
Range | 8 |
Interquartile range (IQR) | 1 |
Descriptive statistics
Standard deviation | 1.0038427 |
---|---|
Coefficient of variation (CV) | 0.10812967 |
Kurtosis | 13.325731 |
Mean | 9.2836928 |
Median Absolute Deviation (MAD) | 0 |
Skewness | -2.8084432 |
Sum | 518290 |
Variance | 1.0077001 |
Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=9)
Value | Count | Frequency (%) |
10 | 28060 | |
9 | 20316 | |
8 | 5305 | 6.9% |
7 | 880 | 1.1% |
6 | 751 | 1.0% |
2 | 211 | 0.3% |
4 | 183 | 0.2% |
5 | 110 | 0.1% |
3 | 12 | < 0.1% |
(Missing) | 21268 |
Value | Count | Frequency (%) |
2 | 211 | 0.3% |
3 | 12 | < 0.1% |
4 | 183 | 0.2% |
5 | 110 | 0.1% |
6 | 751 | 1.0% |
7 | 880 | 1.1% |
8 | 5305 | 6.9% |
9 | 20316 | |
10 | 28060 |
Value | Count | Frequency (%) |
10 | 28060 | |
9 | 20316 | |
8 | 5305 | 6.9% |
7 | 880 | 1.1% |
6 | 751 | 1.0% |
5 | 110 | 0.1% |
4 | 183 | 0.2% |
3 | 12 | < 0.1% |
2 | 211 | 0.3% |
Distinct | 369 |
---|---|
Distinct (%) | 0.5% |
Missing | 0 |
Missing (%) | 0.0% |
Infinite | 0 |
Infinite (%) | 0.0% |
Mean | 15.255642 |
Minimum | 0 |
---|---|
Maximum | 578 |
Zeros | 19400 |
Zeros (%) | 25.2% |
Negative | 0 |
Negative (%) | 0.0% |
Memory size | 602.4 KiB |
Quantile statistics
Minimum | 0 |
---|---|
5-th percentile | 0 |
Q1 | 0 |
median | 4 |
Q3 | 15 |
95-th percentile | 70 |
Maximum | 578 |
Range | 578 |
Interquartile range (IQR) | 15 |
Descriptive statistics
Standard deviation | 32.200955 |
---|---|
Coefficient of variation (CV) | 2.1107571 |
Kurtosis | 37.850035 |
Mean | 15.255642 |
Median Absolute Deviation (MAD) | 4 |
Skewness | 5.0140523 |
Sum | 1176149 |
Variance | 1036.9015 |
Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
Value | Count | Frequency (%) |
0 | 19400 | |
1 | 8459 | 11.0% |
2 | 5532 | 7.2% |
3 | 4113 | 5.3% |
4 | 3278 | 4.3% |
5 | 2720 | 3.5% |
6 | 2288 | 3.0% |
7 | 1964 | 2.5% |
8 | 1781 | 2.3% |
9 | 1588 | 2.1% |
Other values (359) | 25973 |
Value | Count | Frequency (%) |
0 | 19400 | |
1 | 8459 | |
2 | 5532 | 7.2% |
3 | 4113 | 5.3% |
4 | 3278 | 4.3% |
5 | 2720 | 3.5% |
6 | 2288 | 3.0% |
7 | 1964 | 2.5% |
8 | 1781 | 2.3% |
9 | 1588 | 2.1% |
Value | Count | Frequency (%) |
578 | 1 | |
529 | 1 | |
508 | 1 | |
507 | 1 | |
501 | 1 | |
481 | 1 | |
471 | 1 | |
468 | 1 | |
467 | 1 | |
461 | 1 |
Distinct | 949 |
---|---|
Distinct (%) | 1.6% |
Missing | 19543 |
Missing (%) | 25.3% |
Infinite | 0 |
Infinite (%) | 0.0% |
Mean | 1.2611798 |
Minimum | 0.01 |
---|---|
Maximum | 16.56 |
Zeros | 0 |
Zeros (%) | 0.0% |
Negative | 0 |
Negative (%) | 0.0% |
Memory size | 602.4 KiB |
Quantile statistics
Minimum | 0.01 |
---|---|
5-th percentile | 0.06 |
Q1 | 0.27 |
median | 0.77 |
Q3 | 1.71 |
95-th percentile | 4.23 |
Maximum | 16.56 |
Range | 16.55 |
Interquartile range (IQR) | 1.44 |
Descriptive statistics
Standard deviation | 1.461234 |
---|---|
Coefficient of variation (CV) | 1.1586247 |
Kurtosis | 7.2776849 |
Mean | 1.2611798 |
Median Absolute Deviation (MAD) | 0.58 |
Skewness | 2.3060339 |
Sum | 72584.68 |
Variance | 2.1352049 |
Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
Value | Count | Frequency (%) |
1 | 1527 | 2.0% |
0.03 | 1024 | 1.3% |
0.07 | 856 | 1.1% |
0.06 | 817 | 1.1% |
0.04 | 709 | 0.9% |
0.05 | 654 | 0.8% |
0.08 | 621 | 0.8% |
2 | 615 | 0.8% |
0.09 | 609 | 0.8% |
0.17 | 601 | 0.8% |
Other values (939) | 49520 | |
(Missing) | 19543 | 25.3% |
Value | Count | Frequency (%) |
0.01 | 20 | < 0.1% |
0.02 | 359 | 0.5% |
0.03 | 1024 | |
0.04 | 709 | |
0.05 | 654 | |
0.06 | 817 | |
0.07 | 856 | |
0.08 | 621 | |
0.09 | 609 | |
0.1 | 586 |
Value | Count | Frequency (%) |
16.56 | 1 | |
15.69 | 1 | |
15 | 1 | |
14.13 | 1 | |
13.5 | 1 | |
13.26 | 1 | |
12.6 | 1 | |
12.59 | 1 | |
12.5 | 1 | |
12.44 | 1 |
Auto
The auto setting is an interpretable pairwise column metric of the following mapping:- Variable_type-Variable_type : Method, Range
- Categorical-Categorical : Cramer's V, [0,1]
- Numerical-Categorical : Cramer's V, [0,1] (using a discretized numerical column)
- Numerical-Numerical : Spearman's ρ, [-1,1]
This configuration uses the recommended metric for each pair of columns.
Spearman's ρ
The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.
Pearson's r
The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.
Kendall's τ
Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.
Phik (φk)
Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here. A simple visualization of nullity by column.
Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.
The correlation heatmap measures nullity correlation: how strongly the presence or absence of one variable affects the presence of another.
shuttle_id | review_scores_rating | review_scores_comfort | review_scores_amenities | review_scores_trip | review_scores_crew | review_scores_location | review_scores_price | number_of_reviews | reviews_per_month | |
---|---|---|---|---|---|---|---|---|---|---|
0 | 63561 | 97.0 | 10.0 | 9.0 | 10.0 | 10.0 | 9.0 | 10.0 | 133 | 1.65 |
1 | 36260 | 90.0 | 8.0 | 9.0 | 10.0 | 9.0 | 9.0 | 9.0 | 3 | 0.09 |
2 | 57015 | 95.0 | 9.0 | 10.0 | 9.0 | 10.0 | 9.0 | 9.0 | 14 | 0.14 |
3 | 14035 | 93.0 | 10.0 | 9.0 | 9.0 | 9.0 | 10.0 | 9.0 | 39 | 0.42 |
4 | 10036 | 98.0 | 10.0 | 10.0 | 10.0 | 10.0 | 9.0 | 9.0 | 92 | 0.94 |
5 | 45163 | 91.0 | 10.0 | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 26 | 0.77 |
6 | 64643 | 95.0 | 9.0 | 10.0 | 10.0 | 10.0 | 9.0 | 9.0 | 118 | 1.12 |
7 | 23389 | 76.0 | 8.0 | 8.0 | 8.0 | 8.0 | 9.0 | 9.0 | 5 | 0.05 |
8 | 39934 | 96.0 | 10.0 | 10.0 | 10.0 | 10.0 | 10.0 | 9.0 | 38 | 0.49 |
9 | 57063 | 100.0 | 10.0 | 10.0 | 10.0 | 10.0 | 10.0 | 10.0 | 1 | 0.02 |
shuttle_id | review_scores_rating | review_scores_comfort | review_scores_amenities | review_scores_trip | review_scores_crew | review_scores_location | review_scores_price | number_of_reviews | reviews_per_month | |
---|---|---|---|---|---|---|---|---|---|---|
77086 | 55187 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 1 | 1.0 |
77087 | 46301 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 0 | NaN |
77088 | 54977 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 0 | NaN |
77089 | 51748 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 0 | NaN |
77090 | 44668 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 0 | NaN |
77091 | 4368 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 0 | NaN |
77092 | 2983 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 0 | NaN |
77093 | 69684 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 0 | NaN |
77094 | 21738 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 0 | NaN |
77095 | 72645 | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 0 | NaN |