Release-2.1.0
Release-2.1.0
This version adds a more intelligent model partitioning method "LoadBalancePartitioner" In Spark On Angel. By analyzing the distribution of features in the training data in advance, the number of features of each partition can be precisely controlled. This makes the PS load more balanced. The actual tests show that the efficiency of model training can be greatly improved in many cases. This version adds three new algorithms in Spark On Angel: FM algorithm based on FTRL optimizer, K- Core algorithm and feature-parallel GBDT algorithm that can support larger models.
- [ISSUE-639] Load-balanced model partitoner "LoadBalancePartitioner" in Spark On Angel
- [ISSUE-690] Ftrl-FM in Spark On Angel
- [ISSUE-663] K-Core in Spark On Angel
- [ISSUE-680] Feature-parallel GBDT in Spark On Angel