Distributed machine learning platform

Overview
Comments
  • init script issue

    init script issue

    The init script produces:

    fatal: reference is not a tree: 4e8093554080bde69bc66ca15f6fe63de573ef8a
    Unable to checkout '4e8093554080bde69bc66ca15f6fe63de573ef8a' in submodule path 'veles/znicz'
    Failed to checkout submodules, retrying...
    fatal: reference is not a tree: 4e8093554080bde69bc66ca15f6fe63de573ef8a
    Unable to checkout '4e8093554080bde69bc66ca15f6fe63de573ef8a' in submodule path 'veles/znicz'
    Failed to checkout submodules, retrying...
    fatal: reference is not a tree: 4e8093554080bde69bc66ca15f6fe63de573ef8a
    Unable to checkout '4e8093554080bde69bc66ca15f6fe63de573ef8a' in submodule path 
    ...
    

    during a fresh install.

    opened by vshvedov 5
  • Refactor InputJoiner

    Refactor InputJoiner

    Add link_inputs method to InputJoiner class, add input_0, input_1, ..., offset_0, offset_1, ..., length_0, length_1, ... properties for each of the input.

    enhancement 
    opened by ajkxyz 2
  • Add automatically saving plotters to pdf after training

    Add automatically saving plotters to pdf after training

    It is necessary to add the ability to save the results in PDF after the trainings, in any case. This is particularly necessary for a long time training models (for example, imagenet)

    enhancement wontfix migrated from jira 
    opened by Lyubava 1
  • Add the way to extract dereferenced, real unit objects from links_from/to

    Add the way to extract dereferenced, real unit objects from links_from/to

    Unit.links_from and Unit.links_to may contain weak references in order to enable garbage collection. It may confuse users who try to read linked units.

    enhancement 
    opened by vmarkovtsev 1
  • Fix runing veles from python2

    Fix runing veles from python2

    lpodoynitsina@lpodoynitsinau64:~/Projects/Veles$ python Python 2.7.6 (default, Jun 22 2015, 17:58:13) [GCC 4.8.2] on linux2 Type "help", "copyright", "credits" or "license" for more information.

    import veles veles/init.py:67: UserWarning: Cannot expand variables generated by Git, setting them to None warn("Cannot expand variables generated by Git, setting them to None") kwargs={"dry_run": "init", "snapshot": file_name, "stealth": True} Traceback (most recent call last): File "", line 1, in NameError: name 'file_name' is not defined kwargs={"dry_run": "init", "stealth": True} path_to_model = "veles/znicz/samples/MNIST/mnist.py" launcher = veles(path_to_model, **kwargs) Traceback (most recent call last): File "", line 1, in File "veles/init.py", line 179, in call Main = import_module("veles.main").Main TypeError: 'NoneType' object is not callable

    bug invalid 
    opened by Lyubava 0
  • Fix ImagenetAE fine tuning and loader

    Fix ImagenetAE fine tuning and loader

    Data is in a new format after refactoring preparation_imagenet, so we need to fix loader in ImagenetAE. And plotters does not work at fine tuning stage.

    invalid 
    opened by Lyubava 0
  • CVE-2007-4559 Patch

    CVE-2007-4559 Patch

    Patching CVE-2007-4559

    Hi, we are security researchers from the Advanced Research Center at Trellix. We have began a campaign to patch a widespread bug named CVE-2007-4559. CVE-2007-4559 is a 15 year old bug in the Python tarfile package. By using extract() or extractall() on a tarfile object without sanitizing input, a maliciously crafted .tar file could perform a directory path traversal attack. We found at least one unsantized extractall() in your codebase and are providing a patch for you via pull request. The patch essentially checks to see if all tarfile members will be extracted safely and throws an exception otherwise. We encourage you to use this patch or your own solution to secure against CVE-2007-4559. Further technical information about the vulnerability can be found in this blog.

    If you have further questions you may contact us through this projects lead researcher Kasimir Schulz.

    opened by TrellixVulnTeam 0
  • Can't install on ubuntu 16.04

    Can't install on ubuntu 16.04

    using

    wget -O - https://velesnet.ml/ubuntu-install.sh | bash -
    

    got

    ...
    Reading package lists... Done
    W: The repository 'https://velesnet.ml/apt xenial Release' does not have a Release file.
    N: Data from such a repository can't be authenticated and is therefore potentially dangerous to use.
    N: See apt-secure(8) manpage for repository creation and user configuration details.
    E: Failed to fetch https://velesnet.ml/apt/dists/xenial/main/binary-amd64/Packages  404  Not Found
    E: Some index files failed to download. They have been ignored, or old ones used instead.
    Reading package lists... Done
    Building dependency tree       
    Reading state information... Done
    E: Unable to locate package python3-veles
    

    Is project even alive? As for now it seems the only ML framework with full OpenCL support - would sad if you buried it.

    opened by inferrna 4
  • veles documentation is unavailable

    veles documentation is unavailable

    Hello,

    on veles website, the "docs" tab leads to a 404 : https://velesnet.ml/docs Same problem with https://velesnet.ml/jenkins

    I just wanted to warn you Many thanks !

    opened by LTMXcitrus 1
  • Does veles supports opencl 1.1 EP

    Does veles supports opencl 1.1 EP

    Hello,

    we are looking for a deep learning platform to train against a vivante gc2000 gpu from the imx6q board which supports only opencl 1.1 Embedded Profile.

    Does Veles supports that limited version of opencl?

    Thanks

    opened by Mezzano 0
  • description cause mis-understanding.

    description cause mis-understanding.

    Veles actually is a deep learning(DNN) application. But its description says "Distributed machine learning platform". Deep Learning is a subset of Machine Learning, so it should be "Distributed deep learning platform". Thanks.

    opened by glke 1
Owner
Samsung
Samsung Electronics Co.,Ltd.
Samsung
PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice (『飞桨』核心框架,深度学习&机器学习高性能单机、分布式训练和跨平台部署)

English | 简体中文 Welcome to the PaddlePaddle GitHub. PaddlePaddle, as the only independent R&D deep learning platform in China, has been officially open

null 19.4k Dec 30, 2022
Framework and Library for Distributed Online Machine Learning

Jubatus The Jubatus library is an online machine learning framework which runs in distributed environment. See http://jubat.us/ for details. Quick Sta

Jubatus 701 Nov 29, 2022
Microsoft Distributed Machine Learning Toolkit

DMTK Distributed Machine Learning Toolkit https://www.dmtk.io Please open issues in the project below. For any technical support email to dmtk@microso

Microsoft 2.8k Nov 19, 2022
An open source framework that provides a simple, universal API for building distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library.

Ray provides a simple, universal API for building distributed applications. Ray is packaged with the following libraries for accelerating machine lear

null 23.2k Dec 30, 2022
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

Horovod Horovod is a distributed deep learning training framework for TensorFlow, Keras, PyTorch, and Apache MXNet. The goal of Horovod is to make dis

Horovod 12.9k Dec 29, 2022
Ray provides a simple, universal API for building distributed applications.

An open source framework that provides a simple, universal API for building distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library.

null 23.5k Jan 5, 2023
Distributed Synchronization for Python

Distributed Synchronization for Python Tutti is a nearly drop-in replacement for python's built-in synchronization primitives that lets you fearlessly

Hamilton Kibbe 4 Jul 7, 2022
A lightweight python module for building event driven distributed systems

Eventify A lightweight python module for building event driven distributed systems. Installation pip install eventify Problem Developers need a easy a

Eventify 16 Aug 18, 2022
Distributed machine learning platform

Veles Distributed platform for rapid Deep learning application development Consists of: Platform - https://github.com/Samsung/veles Znicz Plugin - Neu

Samsung 897 Dec 5, 2022
XGBoost-Ray is a distributed backend for XGBoost, built on top of distributed computing framework Ray.

XGBoost-Ray is a distributed backend for XGBoost, built on top of distributed computing framework Ray.

null 92 Dec 14, 2022
Distributed-systems-algos - Distributed Systems Algorithms For Python

Distributed Systems Algorithms ISIS algorithm In an asynchronous system that kee

Tony Joo 2 Nov 30, 2022
a distributed deep learning platform

Apache SINGA Distributed deep learning system http://singa.apache.org Quick Start Installation Examples Issues JIRA tickets Code Analysis: Mailing Lis

The Apache Software Foundation 2.7k Jan 5, 2023
PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice (『飞桨』核心框架,深度学习&机器学习高性能单机、分布式训练和跨平台部署)

English | 简体中文 Welcome to the PaddlePaddle GitHub. PaddlePaddle, as the only independent R&D deep learning platform in China, has been officially open

null 19.4k Jan 4, 2023
PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice (『飞桨』核心框架,深度学习&机器学习高性能单机、分布式训练和跨平台部署)

English | 简体中文 Welcome to the PaddlePaddle GitHub. PaddlePaddle, as the only independent R&D deep learning platform in China, has been officially open

null 19.4k Dec 30, 2022
A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.

Light Gradient Boosting Machine LightGBM is a gradient boosting framework that uses tree based learning algorithms. It is designed to be distributed a

Microsoft 14.5k Jan 8, 2023
A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.

Light Gradient Boosting Machine LightGBM is a gradient boosting framework that uses tree based learning algorithms. It is designed to be distributed a

Microsoft 14.5k Jan 8, 2023
A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.

Light Gradient Boosting Machine LightGBM is a gradient boosting framework that uses tree based learning algorithms. It is designed to be distributed a

Microsoft 14.5k Jan 7, 2023
Framework and Library for Distributed Online Machine Learning

Jubatus The Jubatus library is an online machine learning framework which runs in distributed environment. See http://jubat.us/ for details. Quick Sta

Jubatus 701 Nov 29, 2022
Microsoft Distributed Machine Learning Toolkit

DMTK Distributed Machine Learning Toolkit https://www.dmtk.io Please open issues in the project below. For any technical support email to dmtk@microso

Microsoft 2.8k Nov 19, 2022
Uber Open Source 1.6k Dec 31, 2022