Architecting large-scale Artificial Intelligence/Deep Learning data pipelines In part 1 of this series https://bit.ly/2Taw9WH we discussed how Artificial Intelligence/Deep Learning applications and workflows are inherently different from traditional file-based applications. In this post we will examine what alternatives are available to customers, and why SwiftStack is uniquely positioned to meet these requirements. Is the current […]
Architecting large-scale Artificial Intelligence/Deep Learning data pipelines Businesses adopting AI/DL data pipelines for Computer vision, Natural language processing / understanding (NLP /NLU), Anomaly detection, often ask me how to best architect these environments. To answer this, let’s analyze these use cases, and their requirements. Deep learning applications are inherently different from traditional applications The accelerated […]
A few weeks ago, I put together a tutorial on how to get S3 data into TensorFlow and I used pico swiftstack as an example data source. This article goes into a little more detail about what pico swiftstack is and how I used it to quickly test the S3 API. First off, pico swiftstack […]
Github Gist/Google Colab Link When I was looking for code examples of loading data into TensorFlow via the S3 API, the results were pretty sparse (with lots of questions about various error messages). I thought to myself, “someone should really write a tutorial on using S3 data in TensorFlow!” Then, I realized that someone was […]
According to Amita Potnis, IDC Research Director, Platform and Technologies group, “Infrastructure challenges are the primary inhibitor for broader adoption of AI/ML workflows. SwiftStack’s multi-cloud data management solution is the first of its kind in the industry and effectively handles storage I/O challenges faced by edge-to-core-to-cloud, large-scale AI/ML data pipelines.” Over the last several months, […]
GTC 2019 – Nvidia, the datacenter company, and the role of data I am AI – Protector, Guardian, Navigator, Scientist, Healer, Composer – Nvidia’s CEO Jensen Huang started his keynote, highlighting the pervasiveness of Artificial Intelligence and Deep Learning in our lives, work and play. It was a marathon of a keynote and clearly established […]
SwiftStack is staking its claim, working collaboratively with our customers and helping solve scale challenges with their distributed AI/ML pipelines. Over the last several months, SwiftStack has been busy helping two large autonomous vehicle customers.These data pipelines are distributed across edge (vehicle sensors) to core (data center) to cloud/multi-cloud locations, and are challenged with […]
Having been in the storage industry for many years, I am amazed at the opportunity that data has in shaping business transformation – Want to build and monetize new business models? Glean predictive insights? Enable competitive differentiation? I’d like to share some thoughts that I’m seeing shape this dynamic space. Also, if you are going […]
Metadata Life Cycle Organizations of today can easily generate and persist large amounts of data, but this does not come without a challenge: The question, “How can we store all of this data?” has been replaced with, “How can we derive value from all of this data?” Without a logical way to locate something or […]
