Top 10 Reasons To Use Shared Storage On Your Next Project

A lot of people ask me, “Do I really need shared storage?” They think it’s expensive, overly complicated, and not practical for what they're doing. A couple of years ago I’d have agreed with them. Who’s ever walked into a server room, looked at the giant mess of drives and cables and thought “this is what I want, this will make my movie better”? Shared storage is changing though, and quickly becoming the only practical way to deal with the unbelievable amount of content we’re all generating. So without further ado, here are my top 10 reasons you and your team should be using shared storage for your next project:

  1. No more sneakernet drive pyramid - I can’t tell you how many places I’ve worked where in a closet somewhere lives an ever-growing pyramid of external hard drives managed by a lone, overworked Assistant Editor desperately trying to keep an ever-growing number of staff editors and freelancers working with the same media.

    It always starts innocently enough with a small group of editors who each have their own G-RAID or Pegasus. Then business picks up, more machines are added, GFX and sound are brought in, and suddenly there are cloned drives everywhere. Of course all of that data needs to be archived to other hard drives to make room for new projects and then the process starts over again. As the business grows and expands, this leads to an amazingly large, inefficient, and expensive hard drive pyramid (or modern art sculpture) that everyone likes to joke about, but is slowly crushing the souls of your editors and assistants.

    Throw 4K into this boondoggle and that pyramid has just quadrupled in size and the game of “What drive is that project on?” gets even more fun. As long as you’re managing data across single user hard drives this will remain a problem, no matter how meticulous your sharpie and gaffer tape system is. If you see a pyramid growing in your office it might be time to think about shared storage.

  2. Video conform becomes a breeze - If everyone’s working from the same storage, passing XML’s and moving from system to system as you build a larger project with lots of team members becomes WAY more efficient.  Also, if everyone is working with shared GFX and SFX libraries on the server, you’re saving tons of time and not constantly running into the issue of smaller files missing from drive to drive.  You no longer have to worry about media consolidation and making sure everything is in the same directory since everyone is already working from the same directory.

  3. Connect your workflow – Imagine a world where your editor working in FCPX, Premiere, or Avid can easily send an XML or AAF to Resolve to conform to your original media, and your colorist can send out DPX or Open EXR image sequences for your VFX editors to work with in Nuke and After Effects all from the same volume from the full res files. That’s what great shared storage allows for. Think about how much time that saves compared to cloning drives and doing a reconnect every time you get a new XML or project file.

    Once you’ve hit picture lock it becomes really easy for your sound department to get involved in Pro Tools and Logic and have easy access to all of your original sound files for your AAF.  For anyone who has lived in a sneakernet world, not having to constantly relink and manage media is all that really needs to be said in the case for switching to shared storage.

  4. You can take more risks How would you work if you knew your storage could handle anything you threw at it? Would you shoot everything RAW, would you shoot at a higher frame rate, would you add more angles, would you jump into VR? If your storage worked with Mac, Windows & Linux simultaneously, allowed your VFX artists to work in 4K and could connect up more users on the fly would that expand your horizons a bit? Not only that but you wouldn't have to worry about what operating system you hard drive is formatted for. The bottom line is that it leads to less thinking about tech and more thinking about story.

  5. It’s easier than you think I connect to my storage with an app. With the click of a few buttons, I’m up and running, my machine’s been tuned to maximize bandwidth and I’m working. I can even turn auto-mount on when I need it.

  6. Watch folders - Want to set up an FTP?  Want to automatically upload dailies or hook into a DAM, etc...?  This all gets WAY easier on shared storage, as all your editors can access the same watch folders.

  7. Your data is safer - In the sneakernet world, unless you're in a RAID array, if your drive fails there’s a real good chance you data is gone forever. Even if it can be recovered that’s a long and expensive proposition that’ll cause you to miss your deadline anyway. With good shared storage however, there are a number of clever ways that parity can be enabled to permit drive failure with zero data loss, and zero downtime. How about an email when a drive fails, hot swappable spares, or even volumes that can be popped into another box and have all your work reappear? That's how we work in our lab, and you can do the same.

  8. A better way to archive - You may or may not have a system for archiving in place today, and I could write a whole other article on the topic but the takeaway is this: if all of your working media and projects are in the same place, archiving it is a lot easier. The system we designed can even archive in a way similar to Apple’s Time Machine, backing up at regular intervals and letting you roll back to previous iterations of your projects and files which has saved my ass on more than one occasion.

    Not to get all Inception on you, but if your working shared storage archives to more shared storage it means that you can access your archival footage as quickly and easily as your working footage. Let that sink in for a second. As for LTO, it works more efficiently than ever whether you’ve got a rack mounted device connected to your server or a desktop model connected to a client.

  9. In the end it’s cheaper - The second you hit 4 editors, some shared storage actually becomes less expensive than the alternative. Today’s leading 64TB RAID comes in at around $8,000 which will set your team back just over $30K. They’ll more than likely want to work striped for maximum bandwidth, which means no parity or redundancy, an unfortunate but often necessary tradeoff. However for slightly less money a ShareStation Indie would give that same team of 4 editors 70 TB’s of redundant shared storage with all the perks I’ve outlined here, and none of sneakernet nightmares. Plus they’ll have room to grow in both capacity and users at any time. Throw in the amount of time lost during file copies, transcodes, and syncing and the cost/benefit of shared storage becomes even more clear.

  10. Get your flow back Anyone reading this who’s ever worked on a standard XSAN setup with a couple MacMini MDC's will think I’m lying, but shared storage done right can actually perform faster and with less latency than direct attached storage.  Specs are one thing, but at the end of the day we are creative people and these devices are our tools. Film was a very tactile medium and your manipulations in the cut were immediate. That connection to the image is hard to replicate today working in 4K or 6K with the maddening start, wait, playback that happens thousands of times per project. The system I work on now honestly feels like I’m working from an internal SSD. I press the space bar and it plays immediately; no beachballs, no lag, and no dropped frames. Think I’m working in a proxy? I’m not. It’s that freaking fast and responsive. Am I saying shared storage will help you win you an Oscar? No, but you’ve definitely got a better shot when you’re not screaming at your timeline all day.

I hope that helps answer some questions about shared storage. I used to be a sneakernet guy, but now my workflow has totally changed and allowed me to take everything we're doing at We Make Movies to a whole new level. Stay tuned for more on my upcoming pilot, Off The Grid in the coming months.

- Sam Mestman


Sam Mestman is the Co-Founder and CEO of LumaForge Inc. a Los Angeles based storage company. He is also the Founder of Hollywood film collective We Make Movies. He's worked as an editor, colorist, director and technical supervisor with companies such as Apple, Glee, ESPN, & The BBC.


Jellyfish Limited Early Release

For the last year we've been working in the lab trying to figure out how to cram all of the features and performance of our ShareStation line into something you could take with you on a plane. A tall order, but we're a relentless bunch and after a ton trial and error we've developed our newest product known as the Jellyfish. To date we've sent out a few units to super users around the globe to get their feedback, and now we've decided to open this opportunity up to some additional users. You can sign up here to hold your spot, and more information will be released on March 1st.


The Jellyfish - First Glimpse

Neil Smith, our fearless leader in the rapidly evolving world of VR post-production has put out the second installment of his Moviola training series. In this video our newest prototype nicknamed "The Jellyfish" makes an appearance which allows high bandwidth sharing across Mac & PC for editing and stitching. More details on the Jellyfish will be available very soon.


 Stitching and Editing with the Jellyfish prototype.

Stitching and Editing with the Jellyfish prototype.

Cheaper to Fail: iPhone Filmmaking

Last month LumaForge CEO Sam Mestman and his film collective "We Make Movies" set out to test the limits of iPhone filmmaking. 5 teams had 36 hours to write, shoot, edit, and screen a 3 minute movie using only an iPhone as their camera. Once shooting was over all of the footage was loaded onto a single ShareStation Indie at the Santa Monica Apple Store and teams used FCPX and MacBook's connected over 1GbE to cut their films.

Read More

Is VR here to stay? Neil Smith says yes!

Virtual Reality (VR) has been going to change the world ever since the 1950s. Each decade heralds the next coming of VR as the technology that is going to transform human experience and take us into the brave new worlds of virtual gaming, virtual sex and virtual human experience. Only somehow, the promised land of real virtuality never seems to arrive and we're left stranded in the mundane worlds of 2D movies, 2D TV and 2D video games.

So why should VR in 2016 be any different than VR in 1996? Isn’t the so called Next Gen VR just another ‘flash in the pan’ like 3D TV? And more importantly, what has VR gaming got to do with production and post professionals struggling with the day-to-day challenges of shooting, editing and finishing narrative content in a world already saturated with too many films, too much TV and way too many YouTube videos?

There are numerous thing to mention around this topic, and that starts with a not so little company called Facebook purchasing a very little company called Oculus Rift in 2015 for $2 billion dollars and change. That in itself is not remarkable if it were not for a couple of related factors:

  • I don’t believe Mr. Zuckerberg is in the charity business.
  • Facebook has access to more eyeballs on the planet than any other media company.
  • more money is spent on playing video games than on watching Movies and TV combined.

Completely separate from such developments, the relentless impact of Moore’s Law continues to reek havoc on all things digital, and by implication, all things related to the modern digital world we live in now. Pick up your smart phone and take a second to think what you have in your hands. That's more computing power than used to be found in mainframes as large as your house. That device gives you incredible access to people around the globe through the wonder of the Internet and social networks like Twitter, Instagram, Snapchat, YouTube and Facebook.

The mobile, smart phone platform is replacing the PC as the most strategic IT device for human interaction, communication and video content. You can check out Apple, Alphabet and Facebook’s latest financial results to see how important video and mobile are to their revenue streams.

So if we put some of these ingredients into the melting pot and give it a stir, what do we end up with? A perfect storm of Moore’s Law driven technology innovation combined with the largest digital entertainment industry in the world. In other words, video games plus VR plus mobile plus a connected world equals one mega opportunity.

Read the rest of Neil's article at:

Neil Smith teaches VR Workflow

If you're interested in learning about VR Workflow, our intrepid Neil Smith has just put out a tutorial video available through Moviola. In part one of the three part series Neil, who happens to run Virtual Reality production company Rift Valley Studios explains key concepts in the rapidly shifting world of VR, and then dives into spherical capture and workflow challenges.

Video available here:

ShareStation powers A&E O.J. Simpson Doc.

ShareStation powers A&E O.J. Simpson Doc.

Oscar nominated director Chuck Braverman and assistant editor Patrick Southern used the first ever ShareStation to cut the high profile documentary The Secret Tapes of the O.J. Case: The Untold Story for A&E debuting this week.

Working with over 10,000 clips, the team chose to power their FCPX workflow with the ShareStation so they could collaborate across multiple machines in offices as far as 300' apart. All told they had 3 MacPro's connected over 10GbE and 2 Macs over 1Gbe which provided all the bandwidth they needed to work efficiently with the immense amount of footage.

Read More