A Photometric Image-Based Rendering (PIER) concept is proposed that facilitates the generation of an image with an arbitrary illumination. Based on this concept, we aim to generate both diffuse and specular reflections. It is not necessary to explicitly recover 3D shape and reflection properties of the scene. In order to control appearance changes caused by modifications in the lighting conditions, we utilize a set of real images taken, in a variety of lighting conditions. Since the diffuse and specular reflection components have different characteristics, we separate these components and apply different methods to each. A photometric linearization is introduced to control diffuse reflections as well as for separating the other components. This also facilitates the treatment of attached shadows as a part of the diffuse reflection. A morphing technique is utilized to generate specular reflections. This is an effective technique for dealing with glossy objects, even when the light shape is clearly observed in the specular reflection. Experimental results show that realistic images can be successfully generated using this technique.