### ResNet简介 ResNet（Residual Network，残差网络）是一种经典的卷积神经网络架构，在图像识别领域取得了显著的成功。它由何凯明等人于2015年提出，并在ImageNet竞赛中获得了冠军[^1]。ResNet的核心创新在于引入了残差模块（Residual Block），解决了深层网络中的退化问题。 #### 退化问题 随着网络层数增加，训练误差通常会先减小再增大，这种现象被称为退化问题。传统观点认为更深的网络应该具有更强的表现力，但实际上由于优化困难和梯度消失等问题，过深的网络可能导致性能下降。ResNet通过引入跳跃连接（Skip Connection）缓解了这一问题[^3]。 --- ### ResNet核心机制：残差学习 ResNet的主要特点是其残差块的设计。假设目标函数为 \( H(x) \)，传统的前馈网络试图直接拟合 \( H(x) \)，而ResNet则尝试学习一个残差函数 \( F(x)=H(x)-x \)[^1]。最终输出表示为： \[ y = F(x)+x \] 其中 \( x \) 是输入张量，\( y \) 是输出张量。如果恒等映射更容易被学习，则可以通过简单的线性变换实现这一点。这种方式使得网络更易于优化并允许构建非常深的模型。 --- ### 使用PyTorch实现ResNet 以下是基于PyTorch框架的一个简化版ResNet18实现代码示例： ```python import torch.nn as nn import torch class BasicBlock(nn.Module): expansion = 1 def __init__(self, in_channels, out_channels, stride=1, downsample=None): super(BasicBlock, self).__init__() self.conv1 = nn.Conv2d(in_channels, out_channels, kernel_size=3, stride=stride, padding=1, bias=False) self.bn1 = nn.BatchNorm2d(out_channels) self.relu = nn.ReLU(inplace=True) self.conv2 = nn.Conv2d(out_channels, out_channels, kernel_size=3, stride=1, padding=1, bias=False) self.bn2 = nn.BatchNorm2d(out_channels) self.downsample = downsample def forward(self, x): identity = x out = self.conv1(x) out = self.bn1(out) out = self.relu(out) out = self.conv2(out) out = self.bn2(out) if self.downsample is not None: identity = self.downsample(x) out += identity out = self.relu(out) return out class ResNet(nn.Module): def __init__(self, block, layers, num_classes=1000): super(ResNet, self).__init__() self.in_channels = 64 self.conv1 = nn.Conv2d(3, 64, kernel_size=7, stride=2, padding=3, bias=False) self.bn1 = nn.BatchNorm2d(64) self.relu = nn.ReLU(inplace=True) self.maxpool = nn.MaxPool2d(kernel_size=3, stride=2, padding=1) self.layer1 = self._make_layer(block, 64, layers[0], stride=1) self.layer2 = self._make_layer(block, 128, layers[1], stride=2) self.layer3 = self._make_layer(block, 256, layers[2], stride=2) self.layer4 = self._make_layer(block, 512, layers[3], stride=2) self.avgpool = nn.AdaptiveAvgPool2d((1, 1)) self.fc = nn.Linear(512 * block.expansion, num_classes) def _make_layer(self, block, out_channels, blocks, stride=1): downsample = None if stride != 1 or self.in_channels != out_channels * block.expansion: downsample = nn.Sequential( nn.Conv2d(self.in_channels, out_channels * block.expansion, kernel_size=1, stride=stride, bias=False), nn.BatchNorm2d(out_channels * block.expansion), ) layers = [] layers.append(block(self.in_channels, out_channels, stride, downsample)) self.in_channels = out_channels * block.expansion for _ in range(1, blocks): layers.append(block(self.in_channels, out_channels)) return nn.Sequential(*layers) def forward(self, x): x = self.conv1(x) x = self.bn1(x) x = self.relu(x) x = self.maxpool(x) x = self.layer1(x) x = self.layer2(x) x = self.layer3(x) x = self.layer4(x) x = self.avgpool(x) x = torch.flatten(x, 1) x = self.fc(x) return x def resnet18(): """Constructs a ResNet-18 model.""" return ResNet(BasicBlock, [2, 2, 2, 2]) ``` 此代码定义了一个基本版本的ResNet18模型，适用于常见的图像分类任务。`BasicBlock` 类实现了两层卷积操作加上跳跃连接的功能；`ResNet` 则负责堆叠多个 `BasicBlock` 并完成整体网络搭建[^2]。 --- ### 总结 ResNet通过引入残差结构成功克服了深度神经网络中的退化问题，极大地推动了深度学习的发展。借助PyTorch强大的灵活性与易用性，可以快速实现各种规模的ResNet模型用于实际应用。 ---