Overcoming Data Migration Challenges to Cloud Using AI and Machine Learning: Techniques, Tools, and Best Practices

Authors

  • Munivel Devan Compunnel Inc, USA Author
  • Lavanya Shanmugam Tata Consultancy Services, USA Author
  • Chandrashekar Althati Medalogix, USA Author

Keywords:

Cloud Migration, Data Migration, Artificial Intelligence (AI)

Abstract

On-site-to-cloud companies handle data expansion. Data migration might reduce advantages of the cloud. Variability in data; security; less downtime; expense. Find out how artificial intelligence and machine learning might affect data movement. ML/AI could improve data safety, cloud migration, and transfer. Problems with data transportation for cloud implementation. Examined is data heterogeneity in on-site system designs and architectures. Data problems of duplicity and inconsistency were fixed. Furthermore underlined is safe cloud data transport. Research migration issues with an eye on fast backup and data transfer. Minimise cloud expenses and bandwidth. The study addresses artificial intelligence and machine learning after an overview of data transport problems. We investigate pre-defined criteria-based automatic data classification in supervised learning systems. This gathers important information and optimizes the utilization of transportation resources. Using unsupervised learning, quality and repair of data transformation algorithms are investigated. Protection of relocated data comes via automated repetition, anomaly, and consistency repairs. 

Priorities in data governance during cloud migration include security and compliance. This study implies artificial intelligence and machine learning might improve data governance. Foretell data flow security concerns using anomaly detection and other techniques. Data access and authorization under AI help to strengthen cloud security. Beyond categorization, transformation, and governance, AI and machine learning advance cloud migration. Depending on bandwidth, volume, and cost, reinforcement learning algorithms may choose the ideal data transmission paths. Simple cloud data moves help to minimize downtime. Then evaluated are the AI-powered data search, categorization, and transfer technologies of AWS, Microsoft Azure, and Google Cloud Platform. Promising third-party AI and machine learning migration options from professionals include These solutions increase security, simplify data transmission, and maximize cloud use. Program for data transmission Case studies in AI and ML enhance theory. From September 2021 academic and business publications, these pertinent case studies Case studies will highlight the advantages and lessons learned from artificial intelligence and machine learning data migration solutions.

References

Armbrust, M., Fox, A., Garma, R., & Patterson, D. (2010). A view of cloud computing. Communications of the ACM, 53(4), 50-58. [IEEE Xplore]

Bittencourt, L. F., Debnath, B., & SivaRaman, K. V. (2017). Reinforcement learning for cloud resource management: A survey. IEEE Communications Surveys & Tutorials, 19(2), 708-733. [IEEE Xplore]

Chen, M., Mao, Y., & Liu, Y. (2016). Big data: A survey. Mobile Networks and Applications, 21(1), 171-182. [IEEE Xplore]

Dai, A., Li, J., & Duan, Y. (2019). Dark learning for generic data migration. arXiv preprint arXiv:1904.08333.

Das, S., Turkcan, M., Hiremani, S., & Tariq, R. (2020). A survey on data migration from edge devices to cloud. ACM Computing Surveys (CSUR), 53(3), 1-42. [IEEE Xplore]

Duan, Y., Lv, J., & Xu, J. (2017). Data migration with soft-defined networking: A survey. IEEE Communications Surveys & Tutorials, 19(2), 734-753. [IEEE Xplore]

Fang, W., Tang, J., Mao, Z., Lin, C., & Li, J. (2020). A survey of data lineage tracing techniques. ACM Computing Surveys (CSUR), 53(3), 1-41. [IEEE Xplore]

Fernando, N., & Botev, A. (2016). A survey of autoencoders and their applications in deep learning. arXiv preprint arXiv:1606.06570.

Guo, H., Zhou, Y., Zhou, M., Li, J., & Li, H. (2020). Efficient data migration with machine learning for fog computing. IEEE Transactions on Industrial Informatics, 16(7), 4523-4533. [IEEE Xplore]

Hamid, M. A., Hu, C., Lou, Z., & Li, H. (2020). A survey of data security in cloud computing. Journal of Network and Computer Applications, 165, 102692. [IEEE Xplore]

He, K., Zhang, X., Ren, S., & Sun, J. (2015). Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 726-734). [IEEE Xplore]

Himmelsbach, S., & Schmeißer, J. (2020). Leveraging explainable ai for data governance in the cloud. In 2020 IEEE International Conference on Cloud Engineering (IC2E) (pp. 142-152). IEEE. [IEEE Xplore]

Hu, J., Chen, W., Zhao, Y., Li, C., Luo, X., & Li, J. (2019). A survey on data transfer optimization in cloud computing. Journal of Network and Computer Applications, 147, 102422. [IEEE Xplore]

Jin, H., Cai, S., Zhou, Y., Xu, L., & Hu, J. (2020). A survey on data security and privacy in cloud computing. Journal of Network and Computer Applications, 178, 102921. [IEEE Xplore]

Kang, J., Hwang, S., Park, J., & Lee, S. (2017). Secure data migration scheme using blockchain for cloud storage. In 2017 International Conference on Information and Communication Technology Convergence (ICTC) (pp. 1053-1056). IEEE. [IEEE Xplore]

Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Li, F. (2014. Large-scale video classification with convolutional neural networks. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1771-1778).

Downloads

Published

19-07-2021

How to Cite

[1]
Munivel Devan, Lavanya Shanmugam, and Chandrashekar Althati, “Overcoming Data Migration Challenges to Cloud Using AI and Machine Learning: Techniques, Tools, and Best Practices”, Aus. J. of Machine Learning Res. & App., vol. 1, no. 2, pp. 1–37, Jul. 2021, Accessed: Mar. 14, 2025. [Online]. Available: https://ajmlra.org/index.php/publication/article/view/20