大规模船舶数据库重复记录的智能优化算法
|
摘要
船舶数据库中的记录具有一定的冗余特性,用于保持数据库的容错性,这样船舶数据库中存在许多重复记录,为数据库查询带来难题。为了减少大规模船舶数据库重复记录,提高数据库记录查询效率,设计了大规模船舶数据库重复记录的智能优化算法。针对大规模船舶数据库重复记录特点,首先对大规模船舶数据库重复记录进行检测,合理删除一些重复记录,然后设计大规模船舶数据库查询的数学模型,并采用智能优化算法对数学模型的最优解进行搜索,得到大规模船舶数据库查询方案,最后采用VC++程序设计语言实现大规模船舶数据库重复记录检测以及查询算法,并采用具体应用实例验证其性能,结果表明,本文算法可以有效检测到大规模船舶数据库中的重复记录,可以有效降低数据库的冗余特征,而且可以查询用户真正需要的记录,查询精度和查询效率均高于对比算法。
Records in ship database have certain redundancy characteristics, which can be used to maintain the fault tolerance of database. As a result, there are many duplicate records in ship database, which brings difficulties to database query.In order to reduce duplicate records in large-scale ship database and improve the efficiency of database record query, An intelligent optimization algorithm for large-scale ship repeated records in databases is designed.. Aiming at the characteristics of duplicate records in large-scale ship database, firstly, the duplicate records in large-scale ship database are checked, some duplicate records are deleted reasonably, then the mathematical model of model ship database query is designed, and the optimal solution of the mathematical model is searched by intelligent optimization algorithm to obtain large-scale ship database.Finally, the query scheme is implemented by using VC++ programming language to detect and query the duplicate records in large-scale ship databases, and the performance of the algorithm is verified by practical application examples. The results show that the algorithm can effectively detect duplicate records in large-scale ship databases, and can effectively reduce the redundancy characteristics of the database. It can also query the records that users really need, and the query accuracy and query efficiency are high.
Records in ship database have certain redundancy characteristics, which can be used to maintain the fault tolerance of database. As a result, there are many duplicate records in ship database, which brings difficulties to database query.In order to reduce duplicate records in large-scale ship database and improve the efficiency of database record query, An intelligent optimization algorithm for large-scale ship repeated records in databases is designed.. Aiming at the characteristics of duplicate records in large-scale ship database, firstly, the duplicate records in large-scale ship database are checked, some duplicate records are deleted reasonably, then the mathematical model of model ship database query is designed, and the optimal solution of the mathematical model is searched by intelligent optimization algorithm to obtain large-scale ship database.Finally, the query scheme is implemented by using VC++ programming language to detect and query the duplicate records in large-scale ship databases, and the performance of the algorithm is verified by practical application examples. The results show that the algorithm can effectively detect duplicate records in large-scale ship databases, and can effectively reduce the redundancy characteristics of the database. It can also query the records that users really need, and the query accuracy and query efficiency are high.
引文
[1]马可,郑广海.一种针对关系数据库记录的相似重复记录检测算法[J].电脑知识与技术,2018,14(13):25-28.
[2]郭文龙,董建怀.基于模糊综合评判的相似重复记录清洗方法[J].北京信息科技大学学报(自然科学版),2017,32(4):59-63.
[3]梁雪,任剑锋,景丽.基于QPSO-LSSVM的数据库相似重复记录检测算法[J].计算机科学,2012,39(11):157-159,190.
[4]余肖生,胡孙枝.基于SNM改进算法的相似重复记录消除[J].重庆理工大学学报(自然科学),2016,30(4):91-96.
[5]宋人杰,余通,陈宇红,等.基于MapReduce模型的大数据相似重复记录检测算法[J].上海交通大学学报,2018,52(2):214-221.
[2]郭文龙,董建怀.基于模糊综合评判的相似重复记录清洗方法[J].北京信息科技大学学报(自然科学版),2017,32(4):59-63.
[3]梁雪,任剑锋,景丽.基于QPSO-LSSVM的数据库相似重复记录检测算法[J].计算机科学,2012,39(11):157-159,190.
[4]余肖生,胡孙枝.基于SNM改进算法的相似重复记录消除[J].重庆理工大学学报(自然科学),2016,30(4):91-96.
[5]宋人杰,余通,陈宇红,等.基于MapReduce模型的大数据相似重复记录检测算法[J].上海交通大学学报,2018,52(2):214-221.