Collaborative Personalization of Image Enhancement
详细信息 查看全文
- 作者：Ashish Kapoor (1)
Juan C. Caicedo (2)
Dani Lischinski (3)
Sing Bing Kang (1) - 关键词：Image enhancement ; Personalization ; Collaborative filtering ; Crowdsourcing
- 刊名：International Journal of Computer Vision
- 出版年：2014
- 出版时间：May 2014
- 年：2014
- 卷：108
- 期：1-2
- 页码：148-164
- 全文大小：
- 参考文献：1. Buchsbaum, G. (1980). A spatial processor model for object colour perception. / Journal of the Franklin Institute, / 310, 337-50. CrossRef
2. Bychkovsky, V., Paris, S., Chan, E., & Durand, F. (2011). Learning photographic global tonal adjustment with a database of input/output image Pairs. In: / CVPR-1.
3. Caicedo, J., Kapoor, A., & Kang, S. B. (2011). Collaborative personalization of image enhancement. In / CVPR-1.
4. Chua, T. S., Tang, J., Hong, R., Li, H., Luo, Z., & Zheng, Y. (2009). Nus-wide: A real-world web image database from national university of singapore. In / CIVR -9, ACM.
5. Dale, K., Johnson, M. K., Sunkavalli, K., Matusik, W., & Pfister, H. (2009). Image restoration using online photo collections. In / ICCV.
6. Elad, M., & Aharon, M. (2006). Image denoising via sparse and redundant representations over learned dictionaries. / IEEE Trans Image Processing, / 54(12), 3736-745. CrossRef
7. Farid, H. (2001). Blind inverse gamma correction. / IEEE Transactions on Image Processing, / 10(10), 1428-433. CrossRef
8. Farid, H., & Popescu, A. C. (2001). Blind removal of lens distortions. / Journal of the Optical Society of America, / 18(9), 2072-078. CrossRef
9. Fergus, R., Singh, B., Hertzmann, A., Roweis, S. T., & Freeman, W. T. (2006). Removing camera shake from a single photograph. / ACM Transactions on Graphics, / 25(3), 787-94. CrossRef
10. Fogarty, J., Tan, D., Kapoor, A., & Winder, S. (2008). Cueflik: Interactive concept learning in image search. In / Conference on human factors in computing systems (CHI).
11. Freeman, W. T., Jones, T. R., & Pasztor, E. C. (2002). Example-based super-resolution. / IEEE Computer Graphics and Applications, / 22, 56-5.
12. Gehler, P. V., Rother, C., Blake, A., Minka, T., & Sharp, T. (2008). Bayesian color constancy revisited. In / CVPR.
13. Gijsenij, A., & Gevers, T. (2007). Color constancy using natural image statistics. In / CVPR.
14. Grabler, F., Agrawala, M., Li, W., Dontcheva, M., & Igarashi, T. (2009). Generating photo manipulation tutorials by demonstration. / ACM Transactions on Graphics, / 28(3), 1-. CrossRef
15. Hays, J., & Efros, A. (2008). Scene completion using millions of photographs. / Communications of the ACM, / 51(10), 87-4. CrossRef
16. Hsu, E., Mertens, T., Paris, S., Avidan, S., & Durand, F. (2008). Light mixture estimation for spatially varying white balance. / ACM Transactions on Graphics and SIGGRAPH, / 27(3), article 70.
17. Jain, P., Kulis, B., Dhillon, I., & Grauman, K. (2008). Online metric learning and fast similarity search. In / NIPS.
18. Joshi, N., Matusik, W., Adelson, E. H., & Kriegman, D. J. (2010). Personal photo enhancement using example images. / ACM Transactions on Graphics, / 29(2), 1-5. CrossRef
19. Kang, S. B. (2007). Automatic removal of chromatic aberration from a single image. In / CVPR.
20. Kang, S. B., Kapoor, A., & Lischinski, D. (2010). Personalization of image enhancement. In / CVPR.
21. Kapoor, A., Ahn, H., & Picard, R. W. (2005). Mixture of Gaussian processes for combining multiple modalities. In / Workshop on multiple classifier systems, 2005.
22. Koren, Y., Bell, R., & Volinsky, C. (2009). Matrix factorization techniques for recommender systems. / IEEE, Computer Journal, / 42(8), 30-7. CrossRef
23. Krause, A., Singh, A., & Guestrin, C. (2008). Near-optimal sensor placements in gaussian processes: Theory, efficient algorithms and empirical studies. / Journal of Machine Learning Research, / 9, 235-84.
24. Lawrence, N. D., & Urtasun R. (2009). Non-linear matrix factorization with Gaussian processes. In / Proceedings of the 26th annual international conference on machine learning. ACM, 2009.
25. Lin, S., Gu, J., Yamazaki, S., & Shum, H. Y. (2004). Radiometric calibration using a single image. In / CVPR (Vol. 2, pp. 938-45).
26. Liu, D. C., & Nocedal, J. (1989). On the limited memory method for large scale optimization. / Mathematical Programming B, / 45(3), 503-28.
27. Mairal, J., Bach, F., Ponce, J., Sapiro, G., & Zisserman, A. (2009). Non-local sparse models for image restoration. In / ICCV.
28. Marks, J., Andalman, B., Beardsley, P., Freeman, W., Gibson, S., Hodgins, J., et al. (1997). Design galleries: A general approach to setting parameters for computer graphics and animation. In / ACM SIGGRAPH (pp. 389-00).
29. Portilla, J., Strela, V., Wainwright, M. J., & Simoncelli, E. P. (2003). Image denoising using scale mixtures of Gaussians in the wavelet domain. / IEEE Transactions on Image Processing, / 12(11), 1338-351. CrossRef
30. Rennie, J. D. M., & Nathan, S. (2005). Fast maximum margin matrix factorization for collaborative prediction. In / Proceedings of the 22nd international conference on machine learning. ACM, 2005.
31. Russell, B. C., Torralba, A., Murphy, K. P., & Freeman, W. T. (2008). Labelme: A database and web-based tool for image annotation. / IJCV, / 77(1-), 157-73. CrossRef
32. Salakhutdinov, R., & Mnih, A. (2007). Probabilistic matrix factorization. In / Advances in neural information processing systems (Vol. 20). MIT, Cambridge, MA.
33. Sarwar, B., Karypis, G., Konstan, J., & Riedl, J. (2001). Item-based collaborative filtering recommendation algorithms. In / WWW. New York, NY: ACM.
34. Seeger, M. (2004). Gaussian processes for machine learning. / International Journal of Neural Systems, / 14(2), 69-06. CrossRef
35. Shapira, L., Shamir, A., & Cohen-Or, D. (2009). Image appearance exploration by model based navigation.
36. Stanikunas, R. (2004). Investigation of color constancy with a neural network. / Neural Networks, / 17(3), 327-37.
37. Tenenbaum, J. B., de Silva, V., & Langford, J. C. (2000). A global geometric framework for nonlinear dimensionality reduction. / Science, / 290(5500), 2319-323.
38. Tresp, V. (2001). / Neural Information Processing Systems: Mixture of Gaussian Processes 2001.
39. Wilcoxon, F. (1945). Individual comparisons by ranking methods. / Biometrics, / 1, 80-3. CrossRef
40. Wyszecki, G., & Stiles, W. S. (1982). / Color science: Concepts and methods quantitative data and formulae. New York: Wiley. - 作者单位：Ashish Kapoor (1)
Juan C. Caicedo (2)
Dani Lischinski (3)
Sing Bing Kang (1)
1. Microsoft Research, One Microsoft Way, Redmond, WA?, 98052, USA
2. University of Illinois at Urbana-Champaign, 201 North Goodwin Ave., Urbana, IL, 61801, USA
3. The Hebrew University of Jerusalem, Room 73, Ross Building,The Edmond J. Safra Campus, Jerusalem?, 91904, Israel - ISSN：1573-1405
文摘
This paper presents methods for personalization of image enhancement, which could be deployed in photo editing software and also in cloud-based image sharing services. We observe that users do have different preferences for enhancing images and that there are groups of people that share similarities in preferences. Our goal is to predict enhancements for novel images belonging to a particular user based on her specific taste, to facilitate the retouching process on large image collections. To that end, we describe an enhancement framework that can learn user preferences in an individual or collaborative way. The proposed system is based on a novel interactive application that allows to collect user’s enhancement preferences. We propose algorithms to predict personalized enhancements by learning a preference model from the provided information. Furthermore, the algorithm improves prediction performance as more enhancement examples are progressively added. We conducted experiments via Amazon Mechanical Turk to collect preferences from a large group of people. Results show that the proposed framework can suggest image enhancements more targeted to individual users than commercial tools with global auto-enhancement functionalities.