Efficient cloud photo enhancement using compact transform recipes

Cloud image processing is often proposed as a solution to the limited computing power and battery life of mobile devices: it allows complex algorithms to run on powerful servers with virtually unlimited energy supply. Unfortunately, this idyllic picture overlooks the cost of uploading the input and downloading the output images, which can be significantly higher, in both time and energy, than that of local computation. For most practical scenarios, the compression ratios required to make cloud image processing energy and time efficient would degrade an image so severely as to make the result unacceptable. Our work focuses on image enhancements that preserve the overall content of an image. Our key insight is that, in this case, the server can compute and transmit a description of the transformation from input to output, which we call a transform recipe. At equivalent quality, recipes are much more compact than jpeg images: this reduces the data to download. Furthermore, we can fit the parameters of a recipe from a highly-degraded input-output pair, which decreases the data to upload. The client reconstructs an approximation of the true output by applying the recipe to its local high quality input. We show on a dataset of 168 images spanning 10 applications, that recipes can handle a diverse set of image enhancements and, for the same amount of transmitted data, provide much higher fidelity compared to jpeg-compressing both the input and output. We further demonstrate their usefulness in a practical proof of concept system with which

Department dc:contributor.department

Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science.

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2015

Author dc:creator

• Gharbi, Michael (Michael Yanis)

Advisor dc:contributor.advisor

• Frédo Durand

• Electrical Engineering and Computer Science.

Statement dc:rights

• M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission.

Licence dc:rights.uri

• http://dspace.mit.edu/handle/1721.1/7582

Language dc:language.iso

eng

Handle dc:identifier.uri

http://hdl.handle.net/1721.1/99865

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/99865