Cyber-Physical Systems using Reinforcement Learning
Keywords:
Cyber-Physical Systems, Anomaly Detection, Reinforcement Learning, Real-Time DetectionAbstract
Cyber physical system is used to connect network, control, computing, and physics. Industrial automation, smart grids, and autonomous vehicles are prone to anomalies that can trigger system failure because of security breaches. The frequent changes of cyber physics systems make traditional anomaly detection very challenging. The purpose of this study is to proactive CPS anomaly detection using reinforced learning, as learning from ambient interaction, model can identify irregularities in real time and avoid future problems and increase the system security and reliability.
Downloads
References
Zhang, H., Lee, S., & Choi, J. (2021). Industrial process anomaly detection using Q-learning. Journal of Industrial Automation, 44(2), 123-136.
Chen, Z., Zhang, S., & Liu, Y. (2022). Reinforcement learning for anomaly detection in autonomous vehicles: A case study. IEEE Transactions on Cyber-Physical Systems, 18(4), 85-97.
Kim, Y., & Park, H. (2020). A survey of reinforcement learning applications in cyber-physical systems. Journal of AI and Machine Learning, 13(2), 56-70.
Tan, W., & Xu, L. (2019). Computational challenges in reinforcement learning for real-time anomaly detection in CPS. IEEE Transactions on Systems, 27(3), 44-59.
S. Kumari, “AI-Driven Cloud Transformation for Product Management: Optimizing Resource Allocation, Cost Management, and Market Adaptation in Digital Products ”, IoT and Edge Comp. J, vol. 2, no. 1, pp. 29–54, Jun. 2022
Pillai, Vinayak. “Implementing Efficient Data Operations: An Innovative Approach”. Asian Journal of Multidisciplinary Research & Review, vol. 3, no. 6, Dec. 2022, pp. 231-67, https://ajmrr.org/journal/article/view/241.
S. Kumari, “Agile Cloud Transformation in Enterprise Systems: Integrating AI for Continuous Improvement, Risk Management, and Scalability”, Australian Journal of Machine Learning Research & Applications, vol. 2, no. 1, pp. 416–440, Mar. 2022
Zhu, Yue, and Johnathan Crowell. "Systematic Review of Advancing Machine Learning Through Cross-Domain Analysis of Unlabeled Data." Journal of Science & Technology 4.1 (2023): 136-155.
Sangaraju, Varun Varma, and Senthilkumar Rajagopal. "Applications of Computational Models in OCD." In Nutrition and Obsessive-Compulsive Disorder, pp. 26-35. CRC Press.
Sivaraman, Hariprasad. "Self-Healing Test Automation Frameworks Using Reinforcement Learning for Full-Stack Test Automation." Journal of Artificial Intelligence & Cloud Computing. SRC/JAICC-E210. DOI: doi. org/10.47363/JAICC/2022 (1) E210 J Arti Inte & Cloud Comp 1.4 (2022): 2-4.
Singu, Santosh Kumar. "Impact of Data Warehousing on Business Intelligence and Analytics." ESP Journal of Engineering & Technology Advancements 2.2 (2022): 101-113.
S. Kumari, “AI-Enhanced Agile Development for Digital Product Management: Leveraging Data-Driven Insights for Iterative Improvement and Market Adaptation”, Adv. in Deep Learning Techniques, vol. 2, no. 1, pp. 49–68, Mar. 2022
S. Kumari, “AI-Driven Cybersecurity in Agile Cloud Transformation: Leveraging Machine Learning to Automate Threat Detection, Vulnerability Management, and Incident Response”, J. of Art. Int. Research, vol. 2, no. 1, pp. 286–305, Apr. 2022
Sangaraju, Varun Varma, and Kathleen Hargiss. "Zero trust security and multifactor authentication in fog computing environment." Available at SSRN 4472055.
Sivaraman, Hariprasad. (2022). Adaptive Thresholding in ML-Driven Alerting Systems for Reducing False Positives in Production Environments. INTERANTIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT. 6. 10.55041/IJSREM11938.
Pillai, V. “Data Analytics and Engineering in Automobile Data Systems”. Journal of Science & Technology, vol. 4, no. 6, Dec. 2023, pp. 140-79, https://thesciencebrigade.com/jst/article/view/520
S. Kumari, “Cybersecurity in Digital Transformation: Using AI to Automate Threat Detection and Response in Multi-Cloud Infrastructures ”, J. Computational Intel. & Robotics, vol. 2, no. 2, pp. 9–27, Aug. 2022
Sivaraman, Hariprasad. "Behavior-Based DDoS Detection for Multi-Vector Attacks in Hybrid Cloud Environments." Sivaraman H. Behavior-Based DDoS Detection for Multi-Vector Attacks in Hybrid Cloud Environments.
Gupta, R., & Sharma, N. (2021). Data requirements and challenges for reinforcement learning in CPS. Machine Learning Applications Journal, 22(1), 45-59.
Lee, J., & Choi, H. (2020). Robust anomaly detection in dynamic cyber-physical environments using reinforcement learning. IEEE Transactions on Cybernetics, 49(5), 1724-1736.
Yang, P., & Zhu, M. (2021). Interpretable reinforcement learning for anomaly detection in CPS. Journal of AI Research, 37(6), 115-129.
Li, Y., & Zhang, W. (2020). Efficient reinforcement learning for CPS anomaly detection: Model-based and transfer learning approaches. Computational Intelligence, 31(4), 1228-1242.
Zhang, X., & Wang, H. (2021). Q-learning for real-time anomaly detection in industrial automation systems. IEEE Transactions on Automation Science and Engineering, 19(2), 234-247.
Chen, T., & Xu, Q. (2022). Deep reinforcement learning for anomaly detection in autonomous vehicles. IEEE Transactions on Intelligent Transportation Systems, 23(7), 1456-1469.
