We propose a novel technique, called Keypoint-based Surface Representation (KSR). The proposed technique does not require local features around detected keypoints. KSR exploits geometrical relationships between keypoints for surface representation. KSR is tested on 3 popular datasets for 3D modeling and 3D object recognition. KSR achieves superior 3D modeling and recognition results.