url地址重复的检查时,由于时间是毫秒间数据插入会造成重复,我们可以在目标表上面建立一个唯一性索引来解决。
select MAX(item_id) from dbo.SEC_Item
CREATE UNIQUE NONCLUSTERED INDEX FilteredItem_URL ON [SEC_Item]([Brand_ID] ASC,[Item_URLKey] ASC)WHERE item_id>23019118
WITH (PAD_INDEX = OFF, STATISTICS_NORECOMPUTE = OFF, SORT_IN_TEMPDB = OFF, IGNORE_DUP_KEY = OFF, DROP_EXISTING = OFF, ONLINE = OFF, ALLOW_ROW_LOCKS = ON, ALLOW_PAGE_LOCKS = ON) ON [PRIMARY]
where 条件可以筛选过滤以前可能存在重复的不符合索引的记录。
ON [PRIMARY]
是因为“唯一索引的分区依据列必须是索引键的子集”的原因