Skip to content

Release-2.1.0

Compare
Choose a tag to compare
@paynie paynie released this 08 Mar 09:34
· 3 commits to branch-2.1.0 since this release

Release-2.1.0

This version adds a more intelligent model partitioning method "LoadBalancePartitioner" In Spark On Angel. By analyzing the distribution of features in the training data in advance, the number of features of each partition can be precisely controlled. This makes the PS load more balanced. The actual tests show that the efficiency of model training can be greatly improved in many cases. This version adds three new algorithms in Spark On Angel: FM algorithm based on FTRL optimizer, K- Core algorithm and feature-parallel GBDT algorithm that can support larger models.