Engineering Enterprise Cloud Solutions for Data-Intensive Applications: Optimizing Performance, Scalability, and Cost

Authors

  • Rama Krishna Inampudi Independent Researcher, USA Author
  • Mahadu Vinayak Kurkute Stanley Black & Decker Inc, USA Author
  • Prabhu Krishnaswamy Oracle Corp, USA Author

Keywords:

cloud computing, data-intensive applications, performance optimization

Abstract

Engineering Enterprise Cloud Solutions for Data-Intensive Applications: Optimizing Performance, Scalability, and Cost

Big data analytics, artificial intelligence, and IoT are altering data-intensive applications that need for secure, scalable, reasonably priced commercial cloud solutions to examine vast volumes of data. Engineering is required in designing quick, scalable, reasonably priced data-intensive cloud systems. Control massive data, complicated processing, and real-time analytics cloud problems carefully. Research is on hybrid and multi-cloud architectures for data-intensive corporate applications. 

We need faster data transmission, higher throughput, and reduced network latency. System efficiency may be limited by slow storage, retrieval, and processing depending on data-intensity. Review data sharding, caching, and computing resource allocation for low latency and data accessibility. In data-intensive applications, HPC and GPU handle difficult machine learning and deep learning chores. Containerizing and serverless computing might improve data resource agility.

References

J. B. McManus, J. Zeng, and A. D. M. Jr., "Architectural Patterns in Cloud Solutions: A Comparative Analysis," IEEE Transactions on Cloud Computing, vol. 8, no. 6, pp. 1471-1480, Dec. 2020.

Sangaraju, Varun Varma, and Kathleen Hargiss. "Zero trust security and multifactor authentication in fog computing environment." Available at SSRN 4472055.

Tamanampudi, Venkata Mohit. "Predictive Monitoring in DevOps: Utilizing Machine Learning for Fault Detection and System Reliability in Distributed Environments." Journal of Science & Technology 1.1 (2020): 749-790.

S. Kumari, “Cloud Transformation and Cybersecurity: Using AI for Securing Data Migration and Optimizing Cloud Operations in Agile Environments”, J. Sci. Tech., vol. 1, no. 1, pp. 791–808, Oct. 2020.

Pichaimani, Thirunavukkarasu, and Anil Kumar Ratnala. "AI-Driven Employee Onboarding in Enterprises: Using Generative Models to Automate Onboarding Workflows and Streamline Organizational Knowledge Transfer." Australian Journal of Machine Learning Research & Applications 2.1 (2022): 441-482.

Surampudi, Yeswanth, Dharmeesh Kondaveeti, and Thirunavukkarasu Pichaimani. "A Comparative Study of Time Complexity in Big Data Engineering: Evaluating Efficiency of Sorting and Searching Algorithms in Large-Scale Data Systems." Journal of Science & Technology 4.4 (2023): 127-165.

Tamanampudi, Venkata Mohit. "Leveraging Machine Learning for Dynamic Resource Allocation in DevOps: A Scalable Approach to Managing Microservices Architectures." Journal of Science & Technology 1.1 (2020): 709-748.

Inampudi, Rama Krishna, Dharmeesh Kondaveeti, and Yeswanth Surampudi. "AI-Powered Payment Systems for Cross-Border Transactions: Using Deep Learning to Reduce Transaction Times and Enhance Security in International Payments." Journal of Science & Technology 3.4 (2022): 87-125.

Sangaraju, Varun Varma, and Senthilkumar Rajagopal. "Applications of Computational Models in OCD." In Nutrition and Obsessive-Compulsive Disorder, pp. 26-35. CRC Press.

S. Kumari, “AI-Powered Cybersecurity in Agile Workflows: Enhancing DevSecOps in Cloud-Native Environments through Automated Threat Intelligence ”, J. Sci. Tech., vol. 1, no. 1, pp. 809–828, Dec. 2020.

Parida, Priya Ranjan, Dharmeesh Kondaveeti, and Gowrisankar Krishnamoorthy. "AI-Powered ITSM for Optimizing Streaming Platforms: Using Machine Learning to Predict Downtime and Automate Issue Resolution in Entertainment Systems." Journal of Artificial Intelligence Research 3.2 (2023): 172-211.

M. F. Zhani, S. U. Khan, and S. A. Madani, "Scalable Cloud Architectures for Big Data Processing," IEEE Transactions on Cloud Computing, vol. 7, no. 3, pp. 642-655, Jul.-Sep. 2019.

M. A. Jain and M. M. R. Shevade, "Serverless Computing: An Analysis of Scalability and Cost-Optimization Strategies," IEEE Access, vol. 7, pp. 107257-107268, 2019.

K. Y. Zeng and X. Liu, "Latency Reduction Techniques in Cloud Infrastructure: A Review," IEEE Cloud Computing, vol. 6, no. 3, pp. 27-34, May-June 2020.

C. J. Zhang and D. Chen, "Improving Performance with Data Sharding and Caching in Cloud Data Systems," IEEE Transactions on Network and Service Management, vol. 16, no. 4, pp. 1356-1367, Dec. 2021.

M. B. Mokhtar, T. B. Loureiro, and M. Oliveira, "Cloud-based High-Performance Computing: Techniques and Future Prospects," IEEE Transactions on Cloud Computing, vol. 9, no. 8, pp. 3240-3252, 2022.

A. R. Choudhary, V. G. G. D. Sharma, and R. K. Yadav, "Kubernetes for Distributed Cloud Resource Management: Challenges and Solutions," IEEE Transactions on Services Computing, vol. 12, no. 1, pp. 88-102, Jan.-Feb. 2021.

T. M. T. L. R. Zhao and P. R. Huang, "Cost Management Techniques for Cloud-based Big Data Systems," IEEE Transactions on Cloud Computing, vol. 11, no. 5, pp. 1183-1196, Sept.-Oct. 2022.

X. H. Liu, S. Q. Tan, and M. L. Zhang, "Auto-scaling in Cloud Computing: Approaches and Challenges," IEEE Transactions on Cloud Computing, vol. 5, no. 7, pp. 102-113, Jul. 2018.

L. L. Zhang and D. Zeng, "Load Balancing Techniques in Cloud Platforms for Data-Intensive Applications," IEEE Access, vol. 9, pp. 123456-123467, 2021.

A. K. Sharma, "Cloud Security for Data-intensive Applications: Challenges and Solutions," IEEE Cloud Computing, vol. 6, no. 2, pp. 25-30, Mar.-Apr. 2019.

J. S. White, L. J. Martinez, and A. B. Liu, "Cloud Security and Compliance in the Era of Data Privacy Regulations," IEEE Transactions on Information Forensics and Security, vol. 15, no. 3, pp. 773-784, Mar. 2021.

A. S. Anwar, S. K. Shafiq, and J. D. Hudson, "Disaster Recovery Architectures in Cloud Computing for Critical Applications," IEEE Transactions on Services Computing, vol. 10, no. 9, pp. 1641-1655, Sep. 2020.

L. P. Patel and M. A. Hussain, "Data-Intensive Cloud Architectures for Real-Time Analytics: A Review," IEEE Transactions on Industrial Informatics, vol. 18, no. 2, pp. 90-101, Feb. 2021.

W. J. S. Chen and Z. K. Zhang, "Energy-Efficient Approaches for Data Storage and Transfer in Cloud Environments," IEEE Transactions on Cloud Computing, vol. 9, no. 6, pp. 712-724, Jun. 2020.

J. H. Yang, P. R. Tan, and M. L. Tan, "Optimizing Cloud Infrastructure with AI and Machine Learning Algorithms," IEEE Transactions on Neural Networks and Learning Systems, vol. 28, no. 12, pp. 5121-5130, Dec. 2019.

M. B. S. Krishnan and A. R. Sharma, "FinOps: Cloud Financial Management for Enterprises," IEEE Transactions on Cloud Computing, vol. 10, no. 4, pp. 1161-1169, Oct.-Dec. 2021.

S. P. Agarwal, H. C. Yadav, and M. D. Srivastava, "Optimizing Cloud Costs for Big Data Applications: Insights and Strategies," IEEE Transactions on Cloud Computing, vol. 8, no. 9, pp. 1659-1672, 2020.

G. T. Baek and R. M. Callaghan, "The Role of Edge Computing in Data-Intensive Cloud Solutions," IEEE Internet of Things Journal, vol. 7, no. 4, pp. 3582-3594, Apr. 2021.

C. F. Hu, S. N. Ahmed, and K. M. Ziegler, "Future Trends in Cloud Computing for Data-Intensive Applications," IEEE Transactions on Cloud Computing, vol. 11, no. 10, pp. 1998-2010, Oct. 2022.

Downloads

Published

13-02-2023

How to Cite

[1]
Rama Krishna Inampudi, Mahadu Vinayak Kurkute, and Prabhu Krishnaswamy, “Engineering Enterprise Cloud Solutions for Data-Intensive Applications: Optimizing Performance, Scalability, and Cost”, Aus. J. of Machine Learning Res. & App., vol. 3, no. 1, pp. 640–677, Feb. 2023, Accessed: Mar. 14, 2025. [Online]. Available: https://ajmlra.org/index.php/publication/article/view/6