Gallery

LTO Best Practices Part 2: Advanced LTFS Software Can Be the Key to Success

Before you read this, Read Part One first!

The free software that comes with an LTO tape drive is meant only to get you up and running with LTFS so that you can see the contents of your tape in Finder or Explorer. Free software lets you browse the content, but it doesn’t make the content searchable, it doesn’t guide you through the process, and retrieval is excruciatingly slow.

On the other hand, having software that organizes files are keeps track of their positions on the tape is important for performance. Such software can quickly locate files and put them in a logical sequence for optimum retrieval and restore speeds.

Beyond the performance benefits, paid software can walk you through the whole process in order to optimize the archive for video and avoid the pitfalls mentioned above. The idea is to create a good backup from the beginning to prevent problems down the line.

For instance, some paid software forces uncompressed mode during formatting and also automatically formats the tape to meet Discovery Channel’s file-structure specifications, which seem to be the most stringent in the industry right now.

Paid software also makes it easier when it’s time to copy files onto tape. Remember the rule about illegal characters? Advanced LTFS applications analyze names and flag problems with illegal characters so you can fix them before you start the backup. With certain software, you can even configure it to replace illegal characters automatically during the backup process and then restore those characters when you restore the files. This capability is helpful in cases where it’s important to keep the same file name regardless of illegal characters, such as when linked files are referenced by other media.

Likewise, if the files you’re copying contain references or links, the software checks to see if they are valid. If not, it will flag the problem so that you can address it before starting the backup.

It is helpful to have LTFS software that is video-aware. That is, it always knows the typical video formats, the different types of data coming out of different cameras, and how to break up or keep together different data sets when spanning multiple tapes. Video-aware LTFS software can also extract thumbnails and even play proxies before ever pulling anything off the tape.

Finally, unlike free LTFS software, paid software compares source and copied files and performs checksums on the data, a common and often required practice in the postproduction industry. Checksums provide assurance that the source and copied files match exactly and didn’t get corrupted during the backup process. PreRoll Post takes checksums a step further by calculating a checksum again after the file is restored. This extra checksum calculation helps ensure the file wasn’t corrupted during restoration.

It pays to be organized and judicious about what to back up. Most people back up far more than they can use. For example, it almost never makes sense to back up hidden files because they will be incorrect when restored.

Remember the rule of two: It’s not a true archive without at least two copies of the content – most likely on two or more sets of LTO tapes – stored in two different buildings.

LTO and LTFS create a long-term, reliable, economical storage solution. If you’ve never backed up to LTO before, there is a slight learning curve, but with some common sense, best practices, and the right tools, you can easily set up your archive to deliver worthwhile results down the road … with far more reliability than you would ever get from hard disk.

#archivesecurely

Gallery

LTO Best Practices Part 1: You’ve Settled on LTO/LTFS. Now What?

LTO7_giant

Once you’ve decided to create an LTO/LTFS archive, there are some things you need to consider in order to be successful with it. It’s not the same as copying files onto hard disk and sticking it in a storage closet. The mechanics are different, so there are a few more steps, and there are rules associated with LTFS that require some forethought.

One thing to know is that LTO tapes are raw media that do not come formatted, so you have to format them before you can use them. You can format using terminal commands – a cumbersome process that few would undertake – or, when formatting for LTFS, you can do it using LTFS software. After that, any hardware that has LTFS software installed will be able to read the LTO tape. One of the defining characteristics of LTFS is that in the process of formatting, it partitions the tape so that one section stores the actual content and the other section stores an index of metadata. The index allows the tape to be self-describing, which improves archive management. It also helps ensure organizations are compliant with broadcast networks that require indexed tapes.

Another consideration is whether to format the drive in compressed mode, and the short answer is “no.” Operating in compressed mode is useful in the IT industry when backing up things like documents and text files. But in the media industry, where nearly all video files are already compressed into a format that saves space, there’s little to be gained by formatting a tape in compressed mode. In fact, it can slow down the writing and retrieval processes considerably.

Besides formatting considerations, there are rules related to LTFS that affect how you handle your archives. LTFS has its roots in the IT world, where most servers are running UNIX operating systems. In UNIX – and therefore in LTFS – certain characters, such as ampersands and backslashes, are reserved for formatting purposes and are off-limits in folder and file names. For those of us in the video world, who are used to using just about any character we want, those restrictions can cause trouble when setting up an LTFS file structure. That’s why it’s important to know those “illegal” characters and be diligent when naming files. If you use illegal characters, then the archive retrieval process could crash later.

A related issue, and a common stumbling point for most people, is trying to back up files that contain links or references to media that are not part of the backup. Such files can cause restoration to fail because the application is trying to find a file that doesn’t exist. The same thing can happen with files that contain absolute paths, which trace back to a specific point on a hard disk but lead nowhere on a tape.

For more LTO tips and tricks read part two of LTO Best Practices. #archivesecurely

Gallery

CineGear 2016 Wrap Up

CineGear 2016 was our first time attending the LA show – and what a treat it was! The weather was nice and hot but the people were completely cool and friendly. You can expect to see us again at CineGear in the future! Check out our impressions of the show and see what we showed – LOTS of new things coming from Imagine Products this summer!CineGear Collage

Let’s start with the picture collage above, this is a great representation what we saw and what we showed at CineGear. Top left corner; ProxyMill 5 is due out this summer and we showed it off at the Tech Awards banquet – that’s right, we think it’s award worthy! Left middle; Dan the demo man talking about ShotPut Pro Windows on the Surface tablet, imagine how much lighter travel can be with ShotPut Pro on a tablet… and now it’s possible! Bottom left corner; we always find a fun place to toast the end of the show and there was plenty to toast at CineGear 2016. Top middle; showing off our new pop up banners! Bottom middle; there were all kinds of neat toys running around the show. We ran into this guy a number of times, can’t wait to see all the footage of the show he got! Right; it was very cool to be on the Paramount lot. It was neat to get a behind the scenes look at all the different aspects of filming on a studio lot.

So what did we show? And who did we see?

SPP5 new LARGE MW-01

ShotPut Pro This offloading application for Windows and Mac users offers security, reliability and continuity when offloading your assets. Offload from multiple locations,to multiple locations with naming conventions as well as checksums. Don’t trust your valuable content to finder or explorer! Learn more here.

HD-VU2 new SMALL transHD-VU2 The perfect companion to ShotPut Pro! HD-VU2 is a native file viewer that instantly plays over 20 camera formats without transcoding. Add LUTs and sync external audio files for a complete quality check. Watch folders enable HD-VU2 to ‘talk’ to ShotPut Pro and pull in clips for viewing. Learn more here.


PM new SMALL trans-01ProxyMill
Transcode clips to shareable or editable files in just one step with ProxyMill. Burn in time code or a watermark as well as color correction for shareable files. Easily up-res to ProRes for editing as well as merge or stitch clips together. You can also make audio-only files for transcripts. Learn more here.

 

PRP new SMALL trans-01PreRoll Post Our LTFS archiving application can work with any LTO drive and Sony’s Optical Disc Archive. Archive your completed projects or dailies with PreRoll Post easily to multiple locations at the same time. Checksums deliver peace of mind that archives are 100% accurate and secure. Learn more here.

 

Roger Mabon stopped by the booth and talked to us about the archiving solution = PreRoll Post + LTO7 mTape. Watch it here!

Screen Shot 2016-06-09 at 3.32.45 PM

CineGear 2016 was a great show! It’s always nice to meet new people, reconnect with old friends and see all the new cameras, lights, gadgets and toys.

See you at CineGear 2017!