Network render bugs, suggestions, & solutions

johnmeyer wrote on 4/27/2004, 2:37 PM
I would like to pass along, both to users and to Sony, my findings and suggestions from using the Network Render feature of V5.

Render Time Results

Click here to see the results of a render test performed on Vegas 4.0d, then Vegas 5.0a without network rendering, and then with various network rendering options:

Network Render Test

Bugs

1. After you do a network render, the Vegas MRU (most recently used) list in the file menu is populated with some of the intermediate render files. This is just an annoyance, but obviously should be fixed at some point.

2. You cannot put your VEG or render file in the root directory of your local computer drive. If you do, the file that the render creates will have the first letter of the file name truncated and, more importantly, the resulting render will be entirely black.

Helpful hints for other users

1. You (unfortunately) need to specify "mappings" between the local drive/folder paths and the network name that other computers use to access these same locations. This needs to be done for drives where your media assets reside, and the location for your VEG file, and the location where you are going to create the rendered file. You only need to do it for your local computer. You do it in the Network Render Service dialog.

Thus, if your media files (AVI, pictures, sound, etc.) are in the

D:\Media

directory; and if your local computer is called "Donald;" and if you have shared the D:\Media directory as BIN3, then you will need to create a file mapping in the local computer's Render Service dialog that looks like this:
Local	Universal
D:\Media \\Donald\BIN3
You need to do this, apparently, for every folder (i.e., directory) that contains media used in the project. I thought you could just specify the root directory (assuming the drive is shared at the root level, with all subdirectories shared as well), but apparently you need to provide explicit mapping of each directory. Ugly.

[Edit] Read Sony's response below. The last paragraph is not quite correct.

If you are unsure of the names for your local computer mapping, click on Start -> Run, and type: compmgmt.msc and press Enter. Click on Shared Folders, then Shares. You will get a listing of your shared folder names and how they map to paths.

2. You must specify, in the local computer's Render Service dialog, each of the remote computer renderers that you want to use. If the remote computer is named "Mickey," then start the Network Render Service on that remote machine, walk back down the hall to your local computer, and on the Renderers tab of the Render Service dialog, enter Mickey in the Host column and press Enter. You should immediately see Ready appear in the Status column

3. You do not need to specify anything at all in the Render Service dialog for the remote computer(s). This means you don't need to specify file mapping, nor do you need to specify any renderers.

Suggestions to Sony

1. As I listed in the link above, stitching the results back together takes quite a bit of time. Sony could significantly improve these times if it let the stitching take place from one physical drive to another instead of all on the same physical drive. Things really slow down any time you have to both read and write intensively on the same drive. The ideal workflow would be:

a. Media files: Drive D:
b. Render segment files: Drive E
c. Target for stitched files: Drive D

Basically, you want to be able to "bounce back and forth" between two physically different drives. The improvements from doing this are not at all subtle: They can be substantial.

2. Get rid of the mapping requirement. The information on how a drive maps to a given network is available through a Windows call. I am sure that this is one of those things that the engineers didn't have time to get to. There is no reason the user should have to enter this information, and Sony is going to have to field a lot of phone calls from people that commit typos when entering this info and then wonder why the render doesn't work.

3. Get rid of the need to specify the renderers, or at least populate the list automatically and let me disable the ones I don't want to use. Obviously you can design the renderer so that it announces itself on the network, or responds to some sort of a poll. There is absolutely no reason a user should have to know the name of the computer on which a remote client is running and have to type that (correctly, or else ...) into a box. Basically, in a future release, all a user should have to do is launch the renderer on each remote computer, and then specify at the start of the rendering that the render should be assisted by other computers.

4. Create better documentation. I have read and re-read the help file and the PDF manual (surprisingly, no mention whatsoever is made of Network Rendering in the Learn To Use New Features PDF document) and it isn't very clear on many of the points I have brought up in this post.

I hope this helps someone. I don't know much about video editing compared to most people on this forum, but I know more than a little about computers. Network rendering is unnecessarily daunting in this first release. Hopefully Sony will smooth the rough edges. To those for whom shorter rendering times are important, this is a vitally important new feature.

Comments

SonyPJM wrote on 4/27/2004, 2:54 PM
You need to do this, apparently, for every folder (i.e., directory)

No, you only need to map the root directory (except for the bug of
mapping the root directory of the entire drive) For example:

D:\ ==> \\machine\DeeDrive :this is buggy
D:\media ==> \\machine\media : this works fine and the media dir can have media in sub-dirs


There is absolutely no reason a user should have to know the name

Not true unless we scan ports on all the machines on your network (and
beyond). But it may be possible, however, to specify one render service
as a sort of hub but then you'd still have to enter the name of the
hub machine into all of the renderers.


Thanks for your comments.
busterkeaton wrote on 4/27/2004, 3:01 PM
Good work, John.
johnmeyer wrote on 4/27/2004, 3:43 PM
SonyPJM,

Thanks for the clarification on the mapping. That makes things a whole lot easier. It sounds like, therefore, as long as I create a share on something other than the root directory, and then keep all my media assets in folders under that share location, I only have to do one mapping. That helps.
BrianStanding wrote on 5/10/2004, 1:18 PM
I've posted a request on the scripting forum for a script that would identify the appropriate "local" and "universal" descriptor for all media on a timeline. It would seem like this would help speed things up when you need to map directories.

Also, a simple "Browse" button in the Network Mapper would make things much easier, instead of having to type everything in by hand.

I'll be upgrading my Athlon 800 soon to an XP 2400+, so I'm looking forward to taking more advantage of this feature soon. Thanks, John, for the thorough assessment. Good to know that I only need to map the local computer main directory.
johnmeyer wrote on 5/10/2004, 1:36 PM
Good to know that I only need to map the local computer main directory.

Just to make sure you understand, there is a bug in Vegas 5.0a that will prevent you from mapping the root directory. As I said in my first post:

"You cannot put your VEG or render file in the root directory of your local computer drive."

Thus if, when you say: "I only need to map the local computer main directory" you mean the root directory, then that will not work because of the bug. However, if you map a subdirectory (i.e., "folder" in modern Windows parlance), then you do not need to map any subdirectories below that one: They are all included.
BrianStanding wrote on 5/10/2004, 2:08 PM
Got it. Thanks.
rcrawfor42 wrote on 5/28/2004, 7:33 PM



Not necessarily:

1) All the render servers listen to a known port.

2) To find the render servers, the client sends a broadcast message to that port. All machines on the local network will receive the message.

3) The render servers respond to the message by sending a packet to a known port on the client. They provide their name and any other information needed.

Have your network guys look up Multicast Sockets; I have an IDE that uses this type of system for license control. Basically, every time you start it up, it sends a multicast message out. If another copy of the IDE with the same license is running on your network, it shows a little nag message and shuts down. No port scanning necessary; I've seen it work on a rather paranoid corporate network without causing any alarms to go off.
jbecana wrote on 9/30/2004, 10:46 AM
Talking about network bugs, I've just found there is a problem with subclips and network rendering. I rendered a project where two events were created as subclips and then they were rendered to a new track. Well, they show in the media pool as subclips. These two were rendered completely black from another computer. There is no problem with the paths as they are in the same directory as the other clips.
Anybody experimented that?
BTW, I can't find a decent way to send bugs or problems - not a feature suggestion - Is there anyone?
Regards,
Javier.