SwiftStack Blog

TensorFlow 2.0 and Object Storage: Train Neural Networks with Large Datasets

This past summer, I shared a tutorial for how to load large datasets into TensorFlow 1.x from object storage using the S3 API. This new tutorial will show how TensorFlow 2.0 can leverage data from an object store. For those unfamiliar, object storage is the de-facto standard for storing unstructured data in environments requiring massive […]

Containerized S3-compatible Object Storage (the reason for pico swiftstack)

A few weeks ago, my colleague Jon Kelly posted a blog article titled “How I Used pico swiftstack to Test TensorFlow with S3 Storage”. Since pico swiftstack is a relatively new product, I would like to explain why having a containerized S3-compatible object storage option for testing and experimenting is helpful to anyone evaluating scale-out, […]