Forgot password? | Forgot username? | Register

Automating (or speeding up) image upload into KE Emu?

Automating (or speeding up) image upload into KE Emu?

Hi folks,

Something that came up at a discussion this morning...

We are now getting large numbers of very high-resolution digital images of etchings. In order to preserve fine etching detail, the files are collossal: 120Mb not atypical apparently.

We see the  KE Emu multimedia module as our repository for all multimedia, but currently it's not really viable for large numbers of these big files. One optioon would be to store slightly smaller versions of the files, but this would lose some quality, and mean we had to separately administer DVDs or whatever with the original images.

The physical copying of the images from a user PC over the network via drag-and-drop within KE Emu is very slooowww indeed.

The rate-determining step is the physical network speed across campus, getting the big file from a to b.

I'm wondering whether we can speed up this process from a user perspective by automating  some or all of it by eg

a) automated file transfer of the suitable named image files to a folder on the KE Linux box.
b) a shell script (or similar that can be run automatically) to import the (now locally stored) image files into the KE Multimedia module, and ideally, link these entries to the relevant objects in the catalogue module.

The KE client is Windows only, so running any traditional csv-based imports would have to be done on a remote Windows box, and would have to get the files , and then send them back again, which would be even worse. Or is there a cunning way round this?

Hope this description of the issue makes sense.

Any suggestions/advice gratefully received...

Cheers

John

Administrator has disabled public posting. Please login or register in order to proceed.

Re: Automating (or speeding up) image upload into KE Emu?

Hi John,

The EMu Multimedia module is able to handle large multimedia files, although of course this depends on the capacity of the hard disk available on the EMu server to be able to store them.

It is certainly possible to have a script that automatically:
•    Transfers multimedia files to the EMu Multimedia repository,
•    Creates the Multimedia records, and
•    Creates a link to the relevant objects in the Catalogue module.

It would make sense to store all the multimedia files in EMu, including the master files. It is possible to specify that smaller derivatives of images are automatically created in EMu, and that by default users view a smaller version of the image for fast retrieval, with the master image files still accessible in the event that users need them.

KE Software can create the script and set this up for you. However, this will be chargeable work. Please contact your local KE office to arrange this.

Regards,
Helena

________________________________________
Helena Sukmawijaya
KE Software, an Axiell Group Company
Suite 4, Level 3, 189 Kent Street, Sydney NSW 2000
Phone: +61-2-9252 6189 | email: Helena.Sukmawijaya@axiell.com

Helena Sukmawijaya (Axiell Sydney)
useravatar
Offline
8 Posts
Administrator has disabled public posting. Please login or register in order to proceed.

Re: Automating (or speeding up) image upload into KE Emu?

Hi Helena,

Ta for this.

We know that KE Emu has physically handle, store, and auto-create resized images. The backend aspect of image management is basically fine.

The issue is that physicall uploading big images one-at-a-time-by drag and drop, or by individual upload to the multimedia module from a KE Emu client PC is extremely slow, and makes for poor workflow, and user frustration. The issue is probably mostly just a network speed issue across campus, but it is a problem.

This is why I'd like to be able to automate the upload of batches of images to the KE Emu server. Simply moving them without user intervention, to a folder on the KE Linux box is trvial. The issue is how to then get them properly into the KE Emu miltimedia module, and properly linked to the relevant recrods in the catalog module, again without user intervention.

It appears to me that as long as the files are usefully named (eg objectnumber+".tif" or similar), it should be possibe to write a shell script to process them, and run relevant TexQL commands to create/update relevant KE Emu content. As the files are already on the Linux box, and the script would run on the Linux box, and would be automatic, speed should not be an issue.

Or are there better methods of gettign the same outcome? Can the Windows client be scripted using Powershell or similar to process batches of stuff automatically?

Cheers

John



Administrator has disabled public posting. Please login or register in order to proceed.

Re: Automating (or speeding up) image upload into KE Emu?

Hi John,

The Operations module might be of help to create the Multimedia records for your images.
Please see the release notes for further information on this module which will be available to you in your next release.

Or you could use the import tool to load your images and attached them to the relevant Catalogue records at the same time.

Please raise a support ticket if you want to discuss these options further.

Best wishes
Christelle

-----------------------------------------------------------
Christelle Hyppolite
KE Software, an Axiell Group Company
Barclay House, 35 Whitworth St West, Manchester, M1 5NG
149 avenue du Maine 75 014 Paris
Phone: +44-161-236-9209 | 01 53 90 75 54 (prix d'un appel en France)
email: Christelle.Hyppolite@axiell.com

Administrator has disabled public posting. Please login or register in order to proceed.

Re: Automating (or speeding up) image upload into KE Emu?

Hi Christelle

Cheers for this - looks promising.

I'll wait until our next release and then try playing with this.

Thanks again

John

Administrator has disabled public posting. Please login or register in order to proceed.

Re: Automating (or speeding up) image upload into KE Emu?

Hi Christelle,

we had the same issue and ending up using a jpeg as the main image for the record and putting the large archival image (in our case a dng) on the supplementary table. That speeded things up no end and it means that we serve the jpeg to the web from multimedia and can choose whether or not to release the dng.

Just a thought

Sharon

Sharon Grant
Technology Liaison to Science
useravatar
Offline
23 Posts
Website 
Administrator has disabled public posting. Please login or register in order to proceed.

Re: Automating (or speeding up) image upload into KE Emu?

Hi,

we had the same issue and ending up using a jpeg as the main image for the record and putting the large archival image (in our case a dng) on the supplementary table. That speeded things up no end and it means that we serve the jpeg to the web from multimedia and can choose whether or not to release the dng.

btw we batch upload using the import tool.

Just a thought

Sharon

Edited by: Sharon Grant - 19-Dec-14 10:46:09

Sharon Grant
Technology Liaison to Science
useravatar
Offline
23 Posts
Website 
Administrator has disabled public posting. Please login or register in order to proceed.

Re: Automating (or speeding up) image upload into KE Emu?

Just thought id say that this is an issue for us also, and agree it is the network speed, mainly. Very interested in any solutions from the perspective of file naming and automatic upload.

Administrator has disabled public posting. Please login or register in order to proceed.

Re: Automating (or speeding up) image upload into KE Emu?

Just thought id say that this is an issue for us also, and agree it is the network speed, mainly. Very interested in any solutions from the perspective of file naming and automatic upload.

Administrator has disabled public posting. Please login or register in order to proceed.
There are 0 guests and 0 other users also viewing this topic

Board Info

Board Stats
 
Total Topics:
601
Total Polls:
0
Total Posts:
1362
User Info
 
Total Users:
827
Newest User:
Marcus Swann (Axiell Melbourne)
Members Online:
2
Guests Online:
152