Nowadays the Internet of Things (IoT) is a very researched technology. Its concept is “to be able to communicate to the Internet at any time from any place to provide any services for any network to anyone”, getting us closer to a smart environment. However, the security is a sensible point in these applications. An authentication system based on voice biometric is proposed in this paper. This system takes advantage of the voice's property to reach a security system that presents a high accuracy, efficiency and interoperability in the task of authentication. The authentication system proposed is based on three subsystems (Automatic Speaker Verification, detection attack and Speaker Diarization). The performance of each stage was evaluated on two international challenge databases and the Fisher international database.