File Level and Block Level Duplication Detection in Cloud Environment

Nowadays, the most important cloud service is data storage which causes drastic increase in duplicate data, so there is a necessity of efficient usage of storage space. This efficient usage of the storage can be achieved by the avoidance of the replicated data. We propose an idea to identify the duplicated data either at the file level or block level. This integrated feature is implemented using supervised learning algorithm to recognize the duplicated data in the cloud .In supervised algorithm, semi-supervised technique is used to find the similarity between the two files and identify the replicated data. The similarity is the filename and the content of the file. The authentication of the subscriber is provided by the secret key generation while downloading the necessary file. This authentication is essential for the subscriber to download the files that are uploaded by another subscriber. In addition, the status of file should be activating. The downloaded file can be shared between two subscribers. Only the validated original file will be stored in the cloud. This increases the effectiveness of storage when compared to other techniques.