### Python 实现人脸识别、语音识别和动作识别的功能 以下是基于Python的一个综合示例代码，该代码集成了人脸识别、语音识别以及简单的动作识别功能，并通过PyQt5提供了一个友好的用户界面。 #### 1. **人脸识别** 使用OpenCV库加载预训练的Haar Cascade分类器来检测人脸[^1]。 对于更复杂的情绪分类或深度学习模型，可以采用TensorFlow/Keras构建CNN模型并加载权重文件进行预测。 ```python import cv2 def detect_faces(image_path): face_cascade = cv2.CascadeClassifier('haarcascade_frontalface_default.xml') img = cv2.imread(image_path) gray = cv2.cvtColor(img, cv2.COLOR_BGR2GRAY) faces = face_cascade.detectMultiScale(gray, scaleFactor=1.1, minNeighbors=5, minSize=(30, 30)) for (x, y, w, h) in faces: cv2.rectangle(img, (x, y), (x+w, y+h), (255, 0, 0), 2) return img ``` --- #### 2. **语音识别** 利用`speech_recognition`库实现基本的语音转文字功能[^2]。 ```python import speech_recognition as sr def recognize_speech(): recognizer = sr.Recognizer() with sr.Microphone() as source: audio = recognizer.listen(source) try: text = recognizer.recognize_google(audio, language="en-US") return text except Exception as e: return str(e) ``` --- #### 3. **动作识别** 简单地使用姿态估计工具MediaPipe来进行人体关键点检测，从而判断特定的动作（如挥手）。 ```python import mediapipe as mp import numpy as np mp_pose = mp.solutions.pose pose = mp_pose.Pose() def detect_action(frame): results = pose.process(cv2.cvtColor(frame, cv2.COLOR_BGR2RGB)) landmarks = results.pose_landmarks.landmark if results.pose_landmarks else None if not landmarks: return "No person detected" # 判断右手是否抬起超过肩膀高度 right_wrist_y = landmarks[mp_pose.PoseLandmark.RIGHT_WRIST].y right_shoulder_y = landmarks[mp_pose.PoseLandmark.RIGHT_SHOULDER].y if right_wrist_y < right_shoulder_y: return "Hand raised" return "Neutral position" ``` --- #### 4. **UI 集成** 使用PyQt5创建图形化界面，允许用户启动/停止视频流、录制等功能。 ```python from PyQt5.QtWidgets import QApplication, QMainWindow, QPushButton, QLabel, QVBoxLayout, QWidget from PyQt5.QtGui import QImage, QPixmap import sys class MainWindow(QMainWindow): def __init__(self): super().__init__() self.setWindowTitle("AI Recognition System") layout = QVBoxLayout() self.label = QLabel(self) layout.addWidget(self.label) button_start = QPushButton("Start", self) button_stop = QPushButton("Stop", self) layout.addWidget(button_start) layout.addWidget(button_stop) container = QWidget() container.setLayout(layout) self.setCentralWidget(container) app = QApplication(sys.argv) window = MainWindow() window.show() sys.exit(app.exec_()) ``` --- ### 综合说明 上述代码片段展示了如何分别实现人脸识别、语音识别和动作识别的核心逻辑，并提供了基础的UI框架用于交互。完整的项目可能需要进一步优化性能、增强鲁棒性和扩展功能性。