*Result*: Iteration acceleration for distributed learning systems.

Title:
Iteration acceleration for distributed learning systems.
Authors:
Wang, Junxiong1, Wang, Hongzhi1 wangzh@hit.edu.cn, Zhao, Chenxu1, Li, Jianzhong1, Gao, Hong1
Source:
Parallel Computing. Feb2018, Vol. 72, p29-41. 13p.
Subject Terms:
*DISTRIBUTED computing, *ITERATIVE methods (Mathematics), *MACHINE learning, *ALGORITHMS, *MATHEMATICAL optimization
Database:
Academic Search Index

*Further Information*

*During the implementation of iterative machine learning algorithms for objective function optimization in large-scale distributed environment, they can be blocked when some of the machines failed. In this paper, a hybrid approach is proposed to balance the performance and efficiency. In each iteration, the results from failure machines are abandoned. We will discuss the relationship between accuracy and abandon rate which can be formulated as inequations. It is argued that the speed of this process is highly effective and efficient. The algorithm is demonstrated using real distributed environment and shows significant improvement of speedup results. [ABSTRACT FROM AUTHOR]*