CN118819843A - A business monitoring method and system based on cloud computing platform - Google Patents

A business monitoring method and system based on cloud computing platform Download PDF

Info

Publication number
CN118819843A
CN118819843A CN202410884313.1A CN202410884313A CN118819843A CN 118819843 A CN118819843 A CN 118819843A CN 202410884313 A CN202410884313 A CN 202410884313A CN 118819843 A CN118819843 A CN 118819843A
Authority
CN
China
Prior art keywords
cloud computing
computing platform
particle
resource allocation
services
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202410884313.1A
Other languages
Chinese (zh)
Inventor
周福兴
赵兆民
叶成就
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhuhai Zhugang Airport Management Co ltd
Original Assignee
Zhuhai Zhugang Airport Management Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhuhai Zhugang Airport Management Co ltd filed Critical Zhuhai Zhugang Airport Management Co ltd
Priority to CN202410884313.1A priority Critical patent/CN118819843A/en
Publication of CN118819843A publication Critical patent/CN118819843A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3003Monitoring arrangements specially adapted to the computing system or computing system component being monitored
    • G06F11/3006Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3409Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
    • G06F11/3433Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment for load management
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • G06F9/505Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the load
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5061Partitioning or combining of resources

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Quality & Reliability (AREA)
  • Mathematical Physics (AREA)
  • Computer Hardware Design (AREA)
  • Debugging And Monitoring (AREA)

Abstract

本发明涉及一种基于云计算平台的业务监控方法及系统,涉及数据处理技术领域,所述方法:根据云计算平台上各种资源和服务的使用情况数据,以确定动态调整因子;根据预设的优化目标以及动态调整因子,计算每个粒子的适应度值;根据每个粒子的适应度值以及动态调整因子,更新每个粒子的速度和位置,以确定最终的资源分配方案,重复评估粒子适应度和更新粒子状态,直到达到预设的迭代次数,以得到最终的资源分配方案;根据最终的资源分配方案,自动调整云计算平台的资源配置,以得到优化后的资源配置和当前的运行状态。本发明不仅能够实时监控云计算平台的运行状态,还能够根据实际需求进行智能的资源分配,从而提高资源利用率。

The present invention relates to a business monitoring method and system based on a cloud computing platform, and to the field of data processing technology. The method comprises: determining a dynamic adjustment factor according to usage data of various resources and services on the cloud computing platform; calculating the fitness value of each particle according to a preset optimization target and a dynamic adjustment factor; updating the speed and position of each particle according to the fitness value of each particle and the dynamic adjustment factor to determine a final resource allocation scheme, repeatedly evaluating the particle fitness and updating the particle state until a preset number of iterations is reached to obtain a final resource allocation scheme; and automatically adjusting the resource configuration of the cloud computing platform according to the final resource allocation scheme to obtain an optimized resource configuration and a current operating status. The present invention can not only monitor the operating status of the cloud computing platform in real time, but also perform intelligent resource allocation according to actual needs, thereby improving resource utilization.

Description

一种基于云计算平台的业务监控方法及系统A business monitoring method and system based on cloud computing platform

技术领域Technical Field

本发明涉及数据处理技术领域,具体地说,涉及一种基于云计算平台的业务监控方法及系统。The present invention relates to the field of data processing technology, and in particular to a business monitoring method and system based on a cloud computing platform.

背景技术Background Art

云计算平台通过虚拟化技术实现了资源的灵活分配与高效利用,为企业和个人用户提供了强大的计算能力和存储空间。然而,随着云计算平台规模的不断扩大和服务种类的日益增多,如何有效地监控和管理这些资源变得尤为重要。Cloud computing platforms use virtualization technology to achieve flexible allocation and efficient use of resources, providing powerful computing power and storage space for enterprises and individual users. However, with the continuous expansion of cloud computing platforms and the increasing number of service types, how to effectively monitor and manage these resources has become particularly important.

例如,传统的云计算平台监控方法通常侧重于对单一资源或服务的监控,而可能无法全面、实时地反映整个云计算平台的运行状态和性能指标。此外,这些方法在资源分配和优化方面也存在一定的局限性,可能无法根据云计算平台的实时状态和用户需求进行动态调整,导致资源浪费或性能瓶颈。For example, traditional cloud computing platform monitoring methods usually focus on monitoring a single resource or service, and may not be able to fully and real-time reflect the operation status and performance indicators of the entire cloud computing platform. In addition, these methods also have certain limitations in resource allocation and optimization, and may not be able to dynamically adjust according to the real-time status of the cloud computing platform and user needs, resulting in resource waste or performance bottlenecks.

发明内容Summary of the invention

本发明要解决的技术问题在于克服现有技术的不足,提供一种基于云计算平台的业务监控方法及系统,不仅能够实时监控云计算平台的运行状态,还能够根据实际需求进行智能的资源分配,从而提高资源利用率。The technical problem to be solved by the present invention is to overcome the deficiencies of the prior art and provide a business monitoring method and system based on a cloud computing platform, which can not only monitor the operating status of the cloud computing platform in real time, but also perform intelligent resource allocation according to actual needs, thereby improving resource utilization.

为解决上述技术问题,本发明采用技术方案的基本构思是:In order to solve the above technical problems, the basic concept of the technical solution adopted by the present invention is:

第一方面,一种基于云计算平台的业务监控方法,包括:In a first aspect, a business monitoring method based on a cloud computing platform includes:

获取云计算平台上各种资源和服务的使用情况数据;Obtain usage data of various resources and services on the cloud computing platform;

对云计算平台上各种资源和服务的使用情况数据进行自动化分析,以确定云计算平台的运行状态和性能指标;Automated analysis of usage data of various resources and services on the cloud computing platform to determine the operating status and performance indicators of the cloud computing platform;

根据云计算平台的运行状态和性能指标,初始化一组粒子,每个粒子代表一种资源分配方案;According to the operation status and performance indicators of the cloud computing platform, a group of particles are initialized, each particle represents a resource allocation scheme;

根据云计算平台上各种资源和服务的使用情况数据,以确定动态调整因子;Determine dynamic adjustment factors based on usage data of various resources and services on the cloud computing platform;

根据预设的优化目标以及动态调整因子,计算每个粒子的适应度值;Calculate the fitness value of each particle according to the preset optimization goal and dynamic adjustment factor;

根据每个粒子的适应度值以及动态调整因子,更新每个粒子的速度和位置,以确定最终的资源分配方案,重复评估粒子适应度和更新粒子状态,直到达到预设的迭代次数,以得到最终的资源分配方案;According to the fitness value of each particle and the dynamic adjustment factor, the speed and position of each particle are updated to determine the final resource allocation plan. The particle fitness is evaluated and the particle state is updated repeatedly until the preset number of iterations is reached to obtain the final resource allocation plan.

根据最终的资源分配方案,自动调整云计算平台的资源配置,以得到优化后的资源配置和当前的运行状态;According to the final resource allocation plan, the resource configuration of the cloud computing platform is automatically adjusted to obtain the optimized resource configuration and current operating status;

将优化后的资源配置和当前的运行状态,通过监控信号发送至用户端。The optimized resource configuration and current operating status are sent to the user end via monitoring signals.

优选的,对云计算平台上各种资源和服务的使用情况数据进行自动化分析,以确定云计算平台的运行状态和性能指标,包括:Preferably, the usage data of various resources and services on the cloud computing platform are automatically analyzed to determine the operating status and performance indicators of the cloud computing platform, including:

从资源和服务的使用情况数据中,筛选与云计算平台运行状态和性能指标的相关特征;Filter out relevant features of the cloud computing platform's operating status and performance indicators from the resource and service usage data;

根据相关特征,通过肘部法则确定聚类的数量K;According to the relevant features, the number of clusters K is determined by the elbow rule;

根据聚类的数量K,对资源和服务的使用情况数据进行聚类,在聚类过程中,将资源和服务的使用情况数据划分为K个簇,每个簇代表一种相似的运行状态,直到达到预设的迭代次数,以得到聚类结果;Cluster the resource and service usage data according to the number of clusters K. In the clustering process, the resource and service usage data are divided into K clusters, each cluster representing a similar operating state, until a preset number of iterations is reached to obtain a clustering result;

根据聚类结果,确定云计算平台的运行状态和性能指标,包括每个簇的平均值或中位数。Based on the clustering results, the operating status and performance indicators of the cloud computing platform are determined, including the average or median of each cluster.

根据云计算平台上各种资源和服务的使用情况数据,通过计算动态调整因子。The dynamic adjustment factor is calculated based on the usage data of various resources and services on the cloud computing platform.

资源和服务的使用情况数据包括CPU使用率、内存占用、网络带宽以及存储使用情况。Resource and service usage data includes CPU usage, memory usage, network bandwidth, and storage usage.

第二方面,一种基于云计算平台的业务监控系统,包括:In a second aspect, a business monitoring system based on a cloud computing platform includes:

获取模块,用于获取云计算平台上各种资源和服务的使用情况数据;对云计算平台上各种资源和服务的使用情况数据进行自动化分析,以确定云计算平台的运行状态和性能指标;根据云计算平台的运行状态和性能指标,初始化一组粒子,每个粒子代表一种资源分配方案;The acquisition module is used to obtain the usage data of various resources and services on the cloud computing platform; automatically analyze the usage data of various resources and services on the cloud computing platform to determine the operating status and performance indicators of the cloud computing platform; initialize a group of particles according to the operating status and performance indicators of the cloud computing platform, each particle represents a resource allocation plan;

处理模块,用于根据云计算平台上各种资源和服务的使用情况数据,以确定动态调整因子;根据预设的优化目标以及动态调整因子,计算每个粒子的适应度值;根据每个粒子的适应度值以及动态调整因子,更新每个粒子的速度和位置,以确定最终的资源分配方案,重复评估粒子适应度和更新粒子状态,直到达到预设的迭代次数,以得到最终的资源分配方案;根据最终的资源分配方案,自动调整云计算平台的资源配置,以得到优化后的资源配置和当前的运行状态;将优化后的资源配置和当前的运行状态,通过监控信号发送至用户端。The processing module is used to determine the dynamic adjustment factor according to the usage data of various resources and services on the cloud computing platform; calculate the fitness value of each particle according to the preset optimization target and the dynamic adjustment factor; update the speed and position of each particle according to the fitness value of each particle and the dynamic adjustment factor to determine the final resource allocation plan, repeatedly evaluate the particle fitness and update the particle state until the preset number of iterations is reached to obtain the final resource allocation plan; according to the final resource allocation plan, automatically adjust the resource configuration of the cloud computing platform to obtain the optimized resource configuration and the current operating status; send the optimized resource configuration and the current operating status to the user end through the monitoring signal.

第三方面,一种计算设备,包括:According to a third aspect, a computing device includes:

一个或多个处理器;one or more processors;

存储装置,用于存储一个或多个程序,当所述一个或多个程序被所述一个或多个处理器执行,使得所述一个或多个处理器实现所述的方法。The storage device is used to store one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the method described.

第四方面,一种计算机可读存储介质,所述计算机可读存储介质中存储有程序,该程序被处理器执行时实现所述的方法。In a fourth aspect, a computer-readable storage medium stores a program, and when the program is executed by a processor, the method described is implemented.

采用上述技术方案后,本发明与现有技术相比具有以下有益效果:After adopting the above technical solution, the present invention has the following beneficial effects compared with the prior art:

通过获取并分析云计算平台上各种资源和服务的使用情况数据,能够实时监控云计算平台的整体运行状态和性能指标。通过设置粒子群优化算法和动态调整因子,本发明能够根据实际情况动态调整资源分配方案。这种动态优化机制能够显著提高云计算平台的资源利用率,避免资源浪费,并确保平台的高效运行。By acquiring and analyzing the usage data of various resources and services on the cloud computing platform, the overall operation status and performance indicators of the cloud computing platform can be monitored in real time. By setting the particle swarm optimization algorithm and the dynamic adjustment factor, the present invention can dynamically adjust the resource allocation scheme according to the actual situation. This dynamic optimization mechanism can significantly improve the resource utilization of the cloud computing platform, avoid resource waste, and ensure the efficient operation of the platform.

每个粒子的适应度值根据预设的优化目标和动态调整因子进行计算,使得资源分配方案能够随着云计算平台状态的变化而自动调整,增强了系统的自适应性和灵活性。通过不断优化资源配置,本发明能够确保云计算平台始终保持在最佳状态,从而为用户提供更稳定、更快速的服务,极大提升了用户体验。The fitness value of each particle is calculated according to the preset optimization target and dynamic adjustment factor, so that the resource allocation scheme can be automatically adjusted as the state of the cloud computing platform changes, enhancing the adaptability and flexibility of the system. By continuously optimizing resource allocation, the present invention can ensure that the cloud computing platform is always in the best state, thereby providing users with more stable and faster services, greatly improving the user experience.

通过实时监控和动态调整,本发明能够及时发现并解决云计算平台可能出现的问题,如资源瓶颈、性能下降等,从而增强系统的稳定性和可靠性。通过自动化的资源分配和优化,减少了人工干预的需要,降低了云计算平台的运维成本。Through real-time monitoring and dynamic adjustment, the present invention can timely discover and solve problems that may arise in the cloud computing platform, such as resource bottlenecks, performance degradation, etc., thereby enhancing the stability and reliability of the system. Through automated resource allocation and optimization, the need for manual intervention is reduced, reducing the operation and maintenance costs of the cloud computing platform.

附图说明BRIEF DESCRIPTION OF THE DRAWINGS

此处所说明的附图用来提供对本申请的进一步理解,构成本申请的一部分,本申请的示意性实施例及其说明用于解释本申请,并不构成对本申请的不当限定。后文将参照附图以示例性而非限制性的方式详细描述本申请的一些具体实施例。附图中相同的附图标记标示了相同或类似的部件或部分,本领域技术人员应该理解的是,这些附图未必是按比例绘制的,在附图中:The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. Some specific embodiments of the present application will be described in detail in an illustrative and non-restrictive manner with reference to the drawings. The same reference numerals in the drawings indicate the same or similar components or parts. It should be understood by those skilled in the art that these drawings are not necessarily drawn to scale. In the drawings:

图1是本发明一种基于云计算平台的业务监控方法流程示意图。FIG1 is a schematic diagram of a process flow of a business monitoring method based on a cloud computing platform according to the present invention.

图2是本发明一种基于云计算平台的业务监控系统示意图。FIG. 2 is a schematic diagram of a business monitoring system based on a cloud computing platform according to the present invention.

具体实施方式DETAILED DESCRIPTION

为了使本技术领域的人员更好地理解本申请方案,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述。显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都应当属于本申请保护的范围。In order to enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work should fall within the scope of protection of the present application.

本申请下述实施例以基于云计算平台的业务监控方法为例进行详细说明本申请的方案,但是此实施例并不能限制本申请保护范围。The following embodiment of the present application takes the business monitoring method based on the cloud computing platform as an example to explain the solution of the present application in detail, but this embodiment cannot limit the protection scope of the present application.

如图1所示,本发明提供了一种基于云计算平台的业务监控方法,所述方法包括以下步骤:As shown in FIG1 , the present invention provides a service monitoring method based on a cloud computing platform, the method comprising the following steps:

步骤11,获取云计算平台上各种资源和服务的使用情况数据;资源和服务的使用情况数据包括CPU使用率、内存占用、网络带宽以及存储使用情况;Step 11, obtaining usage data of various resources and services on the cloud computing platform; the usage data of resources and services includes CPU usage, memory usage, network bandwidth, and storage usage;

步骤12,对云计算平台上各种资源和服务的使用情况数据进行自动化分析,以确定云计算平台的运行状态和性能指标;Step 12, automatically analyzing the usage data of various resources and services on the cloud computing platform to determine the operating status and performance indicators of the cloud computing platform;

步骤13,根据云计算平台的运行状态和性能指标,初始化一组粒子,每个粒子代表一种资源分配方案;Step 13, according to the operation status and performance indicators of the cloud computing platform, a group of particles are initialized, each particle represents a resource allocation scheme;

步骤14,根据云计算平台上各种资源和服务的使用情况数据,以确定动态调整因子;Step 14, determining a dynamic adjustment factor based on usage data of various resources and services on the cloud computing platform;

步骤15,根据预设的优化目标以及动态调整因子,计算每个粒子的适应度值;Step 15, calculating the fitness value of each particle according to the preset optimization target and the dynamic adjustment factor;

步骤16,根据每个粒子的适应度值以及动态调整因子,更新每个粒子的速度和位置,以确定最终的资源分配方案,重复评估粒子适应度和更新粒子状态,直到达到预设的迭代次数,以得到最终的资源分配方案;Step 16, according to the fitness value of each particle and the dynamic adjustment factor, the speed and position of each particle are updated to determine the final resource allocation plan, and the particle fitness is evaluated and the particle state is updated repeatedly until the preset number of iterations is reached to obtain the final resource allocation plan;

步骤17,根据最终的资源分配方案,自动调整云计算平台的资源配置,以得到优化后的资源配置和当前的运行状态;Step 17, according to the final resource allocation plan, automatically adjust the resource configuration of the cloud computing platform to obtain the optimized resource configuration and current operating status;

步骤18,将优化后的资源配置和当前的运行状态,通过监控信号发送至用户端。Step 18: Send the optimized resource configuration and current operation status to the user end via a monitoring signal.

在本发明实施例中,通过获取并分析云计算平台上各种资源和服务的使用情况数据,能够实时监控云计算平台的整体运行状态和性能指标。通过设置粒子群优化算法和动态调整因子,本发明能够根据实际情况动态调整资源分配方案。这种动态优化机制能够显著提高云计算平台的资源利用率,避免资源浪费,并确保平台的高效运行。每个粒子的适应度值根据预设的优化目标和动态调整因子进行计算,使得资源分配方案能够随着云计算平台状态的变化而自动调整,增强了系统的自适应性和灵活性。通过不断优化资源配置,本发明能够确保云计算平台始终保持在最佳状态,从而为用户提供更稳定、更快速的服务,极大提升了用户体验。通过实时监控和动态调整,本发明能够及时发现并解决云计算平台可能出现的问题,如资源瓶颈、性能下降等,从而增强系统的稳定性和可靠性。通过自动化的资源分配和优化,减少了人工干预的需要,降低了云计算平台的运维成本。In an embodiment of the present invention, by acquiring and analyzing the usage data of various resources and services on the cloud computing platform, the overall operation status and performance indicators of the cloud computing platform can be monitored in real time. By setting the particle swarm optimization algorithm and the dynamic adjustment factor, the present invention can dynamically adjust the resource allocation scheme according to the actual situation. This dynamic optimization mechanism can significantly improve the resource utilization of the cloud computing platform, avoid resource waste, and ensure the efficient operation of the platform. The fitness value of each particle is calculated according to the preset optimization target and the dynamic adjustment factor, so that the resource allocation scheme can be automatically adjusted as the state of the cloud computing platform changes, thereby enhancing the adaptability and flexibility of the system. By continuously optimizing resource configuration, the present invention can ensure that the cloud computing platform is always kept in the best state, thereby providing users with more stable and faster services, greatly improving the user experience. Through real-time monitoring and dynamic adjustment, the present invention can timely discover and solve problems that may occur in the cloud computing platform, such as resource bottlenecks, performance degradation, etc., thereby enhancing the stability and reliability of the system. Through automated resource allocation and optimization, the need for manual intervention is reduced, and the operation and maintenance cost of the cloud computing platform is reduced.

在本发明另一优选的实施例中,设计一套数据收集接口或利用现有的监控工具(如Zabbix、Prometheus等)来收集所需的数据;这些接口应与云计算平台的各个组件(如虚拟机、容器、物理服务器等)紧密集成,以便能够实时、准确地获取资源使用情况。通过监控工具或接口定期(如每秒或每分钟)采集每个计算节点的CPU使用率,CPU使用率通常表示为某个时间段内CPU被占用的时间与该时间段总时间的比例;收集的数据可以包括用户态CPU时间、系统态CPU时间以及空闲时间等,以便更全面地分析CPU的使用情况。监控工具会定期记录每个计算节点的内存使用情况,包括已用内存、空闲内存、缓存内存等,这些数据有助于分析内存的使用效率,以及是否存在内存泄漏或过度使用的情况。In another preferred embodiment of the present invention, a set of data collection interfaces is designed or existing monitoring tools (such as Zabbix, Prometheus, etc.) are used to collect the required data; these interfaces should be closely integrated with various components of the cloud computing platform (such as virtual machines, containers, physical servers, etc.) so that resource usage can be obtained in real time and accurately. The CPU usage of each computing node is collected regularly (such as every second or every minute) through the monitoring tool or interface. The CPU usage is usually expressed as the ratio of the time the CPU is occupied in a certain time period to the total time of the time period; the collected data may include user-state CPU time, system-state CPU time, and idle time, etc., so as to more comprehensively analyze the CPU usage. The monitoring tool will regularly record the memory usage of each computing node, including used memory, free memory, cache memory, etc. These data are helpful for analyzing the efficiency of memory usage and whether there is memory leakage or overuse.

通过网络接口卡(NIC)或其他网络监控工具来收集网络带宽的使用情况,这包括入站和出站的数据流量、网络延迟、丢包率等关键指标,对网络带宽的监控有助于识别网络瓶颈和优化数据传输效率。监控工具会记录存储设备的容量、已用空间、剩余空间以及I/O性能(如读写速度、IOPS等)。收集到的资源使用情况数据会被整合并存储到中央数据库或时间序列数据库中,这些数据可以按照时间戳进行索引,以便后续的数据分析和可视化,在收集和使用这些数据时,需要确保数据的安全性和隐私性,应实施适当的访问控制和加密措施,以防止数据泄露或未经授权的访问。The network bandwidth usage is collected through the network interface card (NIC) or other network monitoring tools, including key indicators such as inbound and outbound data traffic, network latency, packet loss rate, etc. Monitoring of network bandwidth helps identify network bottlenecks and optimize data transmission efficiency. The monitoring tool records the capacity, used space, remaining space, and I/O performance (such as read and write speed, IOPS, etc.) of the storage device. The collected resource usage data will be integrated and stored in a central database or time series database. This data can be indexed by timestamp for subsequent data analysis and visualization. When collecting and using this data, it is necessary to ensure the security and privacy of the data, and appropriate access control and encryption measures should be implemented to prevent data leakage or unauthorized access.

在本发明一优选的实施例中,对云计算平台上各种资源和服务的使用情况数据进行自动化分析,以确定云计算平台的运行状态和性能指标,包括:In a preferred embodiment of the present invention, the usage data of various resources and services on the cloud computing platform are automatically analyzed to determine the operating status and performance indicators of the cloud computing platform, including:

从资源和服务的使用情况数据中,筛选与云计算平台运行状态和性能指标的相关特征;Filter out relevant features of the cloud computing platform's operating status and performance indicators from the resource and service usage data;

根据相关特征,通过肘部法则确定聚类的数量K;According to the relevant features, the number of clusters K is determined by the elbow rule;

根据聚类的数量K,对资源和服务的使用情况数据进行聚类,在聚类过程中,将资源和服务的使用情况数据划分为K个簇,每个簇代表一种相似的运行状态,直到达到预设的迭代次数,以得到聚类结果;Cluster the resource and service usage data according to the number of clusters K. In the clustering process, the resource and service usage data are divided into K clusters, each cluster representing a similar operating state, until a preset number of iterations is reached to obtain a clustering result;

根据聚类结果,确定云计算平台的运行状态和性能指标,包括每个簇的平均值或中位数。Based on the clustering results, the operating status and performance indicators of the cloud computing platform are determined, including the average or median of each cluster.

在本发明实施例中,对收集到的资源和服务使用情况数据进行预处理,包括数据清洗、去重、异常值处理等;接着,从这些数据中筛选出与云计算平台运行状态和性能指标相关的特征,特征包括CPU使用率、内存占用率、网络带宽利用率、存储I/O性能等;通过绘制不同K值的聚类成本(如WSS,Within-Cluster Sum of Squares)曲线图,找到曲线的“肘点”(即成本下降速度突然变缓的点),该点对应的K值即为较佳的聚类数量,根据上一步确定的K值,采用K-means聚类算法对资源和服务的使用情况数据进行聚类,在聚类过程中,算法会随机选择K个初始质心,然后将每个数据点分配给最近的质心,形成K个簇;重新计算每个簇的质心,并重复数据点的分配过程,直到质心的位置不再发生显著变化或达到预设的迭代次数,聚类完成后,每个簇代表了一种相似的运行状态,对于每个簇,可以计算其内部数据点的平均值或中位数,以此来代表该运行状态下的性能指标。例如,可以计算每个簇的平均CPU使用率、平均内存占用率等,从而得到云计算平台在不同运行状态下的性能表现。根据聚类结果,可以确定云计算平台的几种典型运行状态(如空闲状态、轻负载状态、重负载状态等),针对每种运行状态,通过计算簇内数据点的统计特征(如平均值、中位数等),得到该状态下的具体性能指标,这些性能指标可以用于评估云计算平台的性能表现。通过上述步骤,可以实现对云计算平台上各种资源和服务的使用情况数据的自动化分析,进而确定云计算平台的运行状态和性能指标。In the embodiment of the present invention, the collected resource and service usage data are preprocessed, including data cleaning, deduplication, outlier processing, etc. Then, the features related to the operation status and performance indicators of the cloud computing platform are screened out from these data, including CPU usage, memory occupancy, network bandwidth utilization, storage I/O performance, etc. The clustering costs (such as WSS, Within-Cluster Sum of Squares) curve, find the "elbow point" of the curve (that is, the point where the cost reduction rate suddenly slows down), and the K value corresponding to this point is the optimal number of clusters. According to the K value determined in the previous step, the K-means clustering algorithm is used to cluster the resource and service usage data. During the clustering process, the algorithm randomly selects K initial centroids, and then assigns each data point to the nearest centroid to form K clusters; recalculates the centroid of each cluster and repeats the data point assignment process until the position of the centroid no longer changes significantly or reaches the preset number of iterations. After clustering is completed, each cluster represents a similar operating state. For each cluster, the average or median of its internal data points can be calculated to represent the performance indicators under the operating state. For example, the average CPU usage and average memory occupancy of each cluster can be calculated to obtain the performance of the cloud computing platform under different operating states. According to the clustering results, several typical operating states of the cloud computing platform can be determined (such as idle state, light load state, heavy load state, etc.). For each operating state, by calculating the statistical characteristics of the data points in the cluster (such as the average value, median, etc.), the specific performance indicators in the state are obtained. These performance indicators can be used to evaluate the performance of the cloud computing platform. Through the above steps, the automatic analysis of the usage data of various resources and services on the cloud computing platform can be realized, and then the operating state and performance indicators of the cloud computing platform can be determined.

在本发明一优选的实施例中,根据云计算平台的运行状态和性能指标,初始化一组粒子,每个粒子代表一种资源分配方案,包括:In a preferred embodiment of the present invention, a group of particles are initialized according to the operating status and performance indicators of the cloud computing platform, each particle represents a resource allocation scheme, including:

每个粒子将包含位置(代表资源分配方案)和速度两个主要属性,位置可以是一个多维向量,每个维度代表一种资源的分配量,如CPU核心数、内存容量、网络带宽等,速度也是一个多维向量,表示粒子在各个资源维度上的调整方向和速率。Each particle will contain two main attributes: position (representing the resource allocation plan) and speed. The position can be a multidimensional vector, and each dimension represents the allocation amount of a resource, such as the number of CPU cores, memory capacity, network bandwidth, etc. The speed is also a multidimensional vector, indicating the adjustment direction and rate of the particle in each resource dimension.

根据问题的复杂性和所需的搜索精度,确定初始化的粒子数量。粒子数量越多,搜索空间越广泛,但计算成本也越高;基于云计算平台的当前运行状态和性能指标,为每个粒子的位置向量赋予初始值,这些初始值可以根据历史数据、经验规则或随机生成,但要确保它们在合理的资源分配范围内。例如,如果当前CPU使用率高,那么初始化的粒子位置可能在分配更多CPU资源的区域。粒子的初始速度可以设置为零或根据某种分布(如均匀分布或正态分布)随机生成,速度的初始化应考虑到搜索空间的规模和问题的特性,以避免粒子过早收敛或偏离搜索空间。对于每个初始化的粒子(即资源分配方案),使用预定的评价标准(如成本、性能、资源利用率等)进行评估,这个评估将作为后续迭代中粒子更新和选择的基础,完成粒子的初始化和评估后,系统准备进入迭代过程,通过不断更新粒子的位置和速度来搜索最优的资源分配方案。通过这个步骤,为后续的粒子群优化算法提供了一个初始的解空间,每个粒子都代表了一个可能的资源分配方案。在接下来的迭代中,算法将根据每个粒子的性能和适应度来调整它们的位置和速度,以找到最优的资源分配策略。The number of particles to be initialized is determined based on the complexity of the problem and the required search accuracy. The more particles there are, the wider the search space is, but the higher the computational cost is. Based on the current operating status and performance indicators of the cloud computing platform, the position vector of each particle is given an initial value. These initial values can be generated based on historical data, empirical rules or randomly, but they must be ensured to be within a reasonable resource allocation range. For example, if the current CPU usage is high, the position of the initialized particle may be in an area where more CPU resources are allocated. The initial velocity of the particle can be set to zero or randomly generated according to a certain distribution (such as uniform distribution or normal distribution). The initialization of the velocity should take into account the scale of the search space and the characteristics of the problem to avoid premature convergence or deviation of the particle from the search space. For each initialized particle (i.e., resource allocation scheme), a predetermined evaluation criterion (such as cost, performance, resource utilization, etc.) is used for evaluation. This evaluation will serve as the basis for particle update and selection in subsequent iterations. After completing the initialization and evaluation of the particles, the system is ready to enter the iteration process to search for the optimal resource allocation scheme by continuously updating the position and velocity of the particles. Through this step, an initial solution space is provided for the subsequent particle swarm optimization algorithm, and each particle represents a possible resource allocation scheme. In the following iterations, the algorithm will adjust the position and speed of each particle according to its performance and fitness to find the optimal resource allocation strategy.

在本发明一优选的实施例中,根据云计算平台上各种资源和服务的使用情况数据,以确定动态调整因子,包括:In a preferred embodiment of the present invention, the dynamic adjustment factor is determined based on the usage data of various resources and services on the cloud computing platform, including:

根据云计算平台上各种资源和服务的使用情况数据,通过 Based on the usage data of various resources and services on the cloud computing platform,

计算动态调整因子; Calculate dynamic adjustment factors;

其中,DAF是动态调整因子;γ、α、β、δ和∩是权重系数,满足0≤γ,α,β,δ,∈≤1,且α+β=1,δ+∈=1;n是资源类型数量;wi是第i种资源的权重;Ui是第i种资源的使用率;Ri是第i种资源的当前请求量或需求量;Rmax是第i种资源的最大请求量或容量;m是考虑的服务类型数量;Lj是第j种服务的负载指标;Sj是第j种服务的当前并发量或会话数;Smax是第j种服务的最大并发量或会话数;p是时间段数量;Tk是第k个时间段内的平均响应时间或延迟;q是用户反馈数量;Vl是第l个用户反馈的评分或满意度;i、j、l和k为索引。Where DAF is the dynamic adjustment factor; γ, α, β, δ and ∩ are weight coefficients, satisfying 0≤γ, α, β, δ,∈≤1, and α+β=1, δ+∈=1; n is the number of resource types; wi is the weight of the i-th resource; Ui is the utilization rate of the i-th resource; Ri is the current request volume or demand volume of the i-th resource; Rmax is the maximum request volume or capacity of the i-th resource; m is the number of service types considered; Lj is the load indicator of the j-th service; Sj is the current concurrency or number of sessions of the j-th service; Smax is the maximum concurrency or number of sessions of the j-th service; p is the number of time periods; Tk is the average response time or delay in the k-th time period; q is the number of user feedback; Vl is the score or satisfaction of the l-th user feedback; i, j, l and k are indexes.

在本发明实施例中,该动态调整因子(DAF)综合考虑了多种资源和服务的使用情况,包括资源使用率、服务负载、响应时间以及用户反馈等,从而能够更全面、准确地反映云计算平台的实际运行状态和需求。由于DAF是基于实时的资源和服务使用数据计算得出的,因此它能够动态地适应云计算平台的变化。当资源需求、服务负载或用户反馈发生变化时,DAF会相应地调整,为资源分配提供及时的指导。公式中的权重系数(如γ、α、β、δ和ε)可以根据实际情况进行调整,这使得DAF具有更高的灵活性和可定制性。通过纳入用户反馈(如评分或满意度),DAF能够更直接地反映用户对云计算服务的感受。通过动态调整资源分配方案,基于DAF的优化策略可以帮助云计算平台在保障性能的同时,提高资源利用效率,减少资源浪费,并增强系统的稳定性。In an embodiment of the present invention, the dynamic adjustment factor (DAF) comprehensively considers the usage of multiple resources and services, including resource utilization, service load, response time, and user feedback, so as to more comprehensively and accurately reflect the actual operation status and demand of the cloud computing platform. Since DAF is calculated based on real-time resource and service usage data, it can dynamically adapt to changes in the cloud computing platform. When resource demand, service load or user feedback changes, DAF will adjust accordingly to provide timely guidance for resource allocation. The weight coefficients in the formula (such as γ, α, β, δ and ε) can be adjusted according to actual conditions, which makes DAF more flexible and customizable. By incorporating user feedback (such as ratings or satisfaction), DAF can more directly reflect the user's feelings about cloud computing services. By dynamically adjusting the resource allocation scheme, the optimization strategy based on DAF can help the cloud computing platform improve resource utilization efficiency, reduce resource waste, and enhance system stability while ensuring performance.

在本发明一优选的实施例中,根据预设的优化目标以及动态调整因子,计算每个粒子的适应度值,包括:In a preferred embodiment of the present invention, the fitness value of each particle is calculated according to the preset optimization target and the dynamic adjustment factor, including:

根据预设的优化目标以及动态调整因子,通过 计算每个粒子的适应度值,其中,Fiti是第i个粒子的适应度值;DAFi是根据第i个粒子的位置计算出的动态调整因子;DAFt是预设的优化目标中期望达到的动态调整因子值;Costi是与第i个粒子相关的成本。According to the preset optimization goals and dynamic adjustment factors, Calculate the fitness value of each particle, where Fit i is the fitness value of the i-th particle; DAF i is the dynamic adjustment factor calculated based on the position of the i-th particle; DAF t is the dynamic adjustment factor value expected to be achieved in the preset optimization goal; Cost i is the cost associated with the i-th particle.

在本发明实施例中,适应度函数的设计考虑了预设的优化目标(即期望达到的动态调整因子值)。这确保了优化过程是有目标导向的,能够专注于提升那些对达到优化目标最为关键的粒子。适应度值的计算不仅考虑了动态调整因子与目标的接近程度,还通过成本项的引入,平衡了性能提升与资源成本之间的关系。这有助于避免过度投入资源以追求性能提升,从而实现经济效益与性能优化的平衡。由于动态调整因子是根据每个粒子的位置实时计算得出的,因此适应度值也能够动态地反映粒子在当前环境下的优劣。这种动态适应性有助于算法在变化的云计算环境中持续有效地进行资源分配优化。适应度函数采用了平滑的过渡形式(通过分数形式实现),这避免了在优化过程中出现突变或跳跃,有助于算法的稳定收敛。该适应度值的计算方案不仅适用于特定的云计算环境或应用场景,而且通过调整预设的优化目标和成本函数,可以灵活地应用于多种不同的云计算资源分配问题。通过综合考虑动态调整因子和成本,该适应度函数有助于引导粒子群算法在全局范围内搜索最优解,而不仅仅是陷入局部最优。In an embodiment of the present invention, the design of the fitness function takes into account the preset optimization goal (i.e., the dynamic adjustment factor value expected to be achieved). This ensures that the optimization process is goal-oriented and can focus on improving the particles that are most critical to achieving the optimization goal. The calculation of the fitness value not only takes into account the proximity of the dynamic adjustment factor to the goal, but also balances the relationship between performance improvement and resource cost through the introduction of the cost term. This helps to avoid excessive investment of resources in pursuit of performance improvement, thereby achieving a balance between economic benefits and performance optimization. Since the dynamic adjustment factor is calculated in real time based on the position of each particle, the fitness value can also dynamically reflect the pros and cons of the particle in the current environment. This dynamic adaptability helps the algorithm to continuously and effectively optimize resource allocation in a changing cloud computing environment. The fitness function adopts a smooth transition form (implemented in a fractional form), which avoids mutations or jumps during the optimization process and helps the stable convergence of the algorithm. The calculation scheme of the fitness value is not only applicable to specific cloud computing environments or application scenarios, but also can be flexibly applied to a variety of different cloud computing resource allocation problems by adjusting the preset optimization goals and cost functions. By comprehensively considering the dynamic adjustment factor and cost, the fitness function helps guide the particle swarm algorithm to search for the optimal solution globally instead of just falling into the local optimum.

在本发明一优选的实施例中,在根据每个粒子的适应度值以及动态调整因子,更新每个粒子的速度和位置当中,速度的更新公式为:In a preferred embodiment of the present invention, when updating the speed and position of each particle according to the fitness value of each particle and the dynamic adjustment factor, the speed update formula is:

其中,分别是第i个粒子在时间t和t+1的速度;w是惯性权重,c1和c2是学习因子,r1和r2是介于0和1之间的随机数;pi是第i个粒子的最优位置;gb是所有粒子的全局最优位置。in, and are the velocities of the ith particle at time t and t+1 respectively; w is the inertia weight, c1 and c2 are learning factors, r1 and r2 are random numbers between 0 and 1; pi is the optimal position of the ith particle; gb is the global optimal position of all particles.

在本发明实施例中,惯性权重w有助于平衡全局搜索和局部搜索的能力。一个较大的w值有利于全局搜索,而较小的w值则更倾向于局部搜索。通过调整w的大小,可以控制粒子在搜索空间中的探索和开发能力。学习因子c1它决定了粒子向其自身历史最优位置学习的程度。随机数r1它为这种学习引入了随机性,有助于粒子在搜索空间中更广泛地探索。学习因子c2决定了粒子向全局最优位置学习的程度。随机数r2同样为这种学习引入了随机性,有助于粒子之间共享信息,促进整个粒子群向全局最优解收敛。系数c3引入了动态调整因子与预设目标之间的差异来影响粒子的速度更新,这使得粒子能够根据当前的动态调整因子值与目标值之间的差距来调整其搜索方向和速度,从而更加直接地朝着优化目标前进。In an embodiment of the present invention, the inertia weight w helps to balance the capabilities of global search and local search. A larger w value is conducive to global search, while a smaller w value is more inclined to local search. By adjusting the size of w, the exploration and development capabilities of particles in the search space can be controlled. The learning factor c 1 determines the extent to which the particle learns from its own historical optimal position. The random number r 1 introduces randomness to this learning, which helps the particles to explore more widely in the search space. The learning factor c 2 determines the extent to which the particle learns from the global optimal position. The random number r 2 also introduces randomness to this learning, which helps to share information between particles and promote the convergence of the entire particle swarm to the global optimal solution. The coefficient c 3 introduces the difference between the dynamic adjustment factor and the preset target to affect the speed update of the particle, which enables the particle to adjust its search direction and speed according to the gap between the current dynamic adjustment factor value and the target value, so as to move more directly towards the optimization goal.

在本发明一优选的实施例中,在根据每个粒子的适应度值以及动态调整因子,更新每个粒子的速度和位置当中,位置的更新公式为:In a preferred embodiment of the present invention, when updating the speed and position of each particle according to the fitness value of each particle and the dynamic adjustment factor, the updating formula of the position is:

其中,分别是第i个粒子在时间t和t+1的位置。in, and are the positions of the i-th particle at time t and t+1 respectively.

在本发明实施例中,由于速度是根据粒子的个体最优位置、全局最优位置以及动态调整因子等多个因素计算得出的,因此它反映了粒子在搜索空间中的动态行为,这使得位置更新能够适应搜索过程的进展,并有助于粒子向更优的位置移动。位置更新公式提供了粒子在搜索空间中的连续移动。这种连续性有助于算法在搜索过程中保持稳定性和平滑性,避免突变或跳跃,从而有助于找到更优的解。通过考虑粒子的个体最优和全局最优位置,以及动态调整因子的影响,位置更新公式使得粒子能够根据搜索过程的进展自适应地调整其移动方向和步长。这种自适应性有助于算法在不同的搜索阶段采取不同的策略,从而更好地平衡探索和开发能力。In the embodiment of the present invention, due to the speed It is calculated based on multiple factors such as the individual optimal position of the particle, the global optimal position, and the dynamic adjustment factor. Therefore, it reflects the dynamic behavior of the particle in the search space, which enables the position update to adapt to the progress of the search process and helps the particle move to a better position. The position update formula provides continuous movement of particles in the search space. This continuity helps the algorithm maintain stability and smoothness during the search process, avoid mutations or jumps, and thus helps find a better solution. By considering the individual optimal and global optimal positions of the particles, as well as the influence of the dynamic adjustment factor, the position update formula enables the particle to adaptively adjust its movement direction and step size according to the progress of the search process. This adaptability helps the algorithm adopt different strategies at different search stages, thereby better balancing exploration and development capabilities.

步骤17,经过前面的优化算法(如粒子群优化算法)运行后,会得到一个最终的资源分配方案。这个方案详细说明了各个计算节点或服务应该分配多少资源(如CPU核心数、内存大小、存储容量、网络带宽等);在实际应用资源分配方案之前,系统会进行一系列的验证检查,确保方案的合理性和可行性。例如,检查资源总量是否超出云平台的实际承载能力,以及是否满足各种服务级别协议(SLA)的要求;一旦方案通过验证,云计算平台的管理系统(如Kubernetes、OpenStack等)会开始执行资源调整命令,这包括启动或关闭虚拟机、调整容器的资源配额、重新分配网络带宽等;在资源调整过程中,系统会实时监控各项指标的变化,如资源利用率、服务响应时间等,以确保调整过程顺利进行且没有对服务造成不良影响;调整完成后,系统会记录新的资源配置情况,并更新云计算平台的运行状态。Step 17, after the previous optimization algorithm (such as particle swarm optimization algorithm) runs, a final resource allocation plan will be obtained. This plan details how much resources (such as the number of CPU cores, memory size, storage capacity, network bandwidth, etc.) should be allocated to each computing node or service; before the resource allocation plan is actually applied, the system will perform a series of verification checks to ensure the rationality and feasibility of the plan. For example, check whether the total amount of resources exceeds the actual carrying capacity of the cloud platform and whether it meets the requirements of various service level agreements (SLAs); once the plan is verified, the management system of the cloud computing platform (such as Kubernetes, OpenStack, etc.) will start to execute resource adjustment commands, which include starting or shutting down virtual machines, adjusting container resource quotas, reallocating network bandwidth, etc.; during the resource adjustment process, the system will monitor the changes of various indicators in real time, such as resource utilization, service response time, etc., to ensure that the adjustment process is carried out smoothly and without adverse effects on the service; after the adjustment is completed, the system will record the new resource configuration and update the operating status of the cloud computing platform.

步骤18,系统会收集优化后的资源配置详细信息,包括每个节点或服务分配到的具体资源量,以及云计算平台当前的运行状态数据(如CPU使用率、内存占用率、网络吞吐量等);收集到的数据会被格式化成用户易于理解的报告或图表形式。这有助于用户直观地了解资源优化后的效果和云平台的运行状态;根据用户的偏好和系统的配置,选择合适的通信协议和方式将数据发送给用户端,这可能是通过电子邮件、短信通知、Web界面更新、API调用或其他自定义的通信方式;将格式化后的数据作为监控信号发送给用户端。用户可以根据这些信息评估资源优化的效果,以及云平台当前的性能和健康状况;用户接收到监控信号后,可以根据实际情况提供反馈,并可能需要对资源分配方案进行微调,以更好地满足业务需求或性能要求。这些反馈和调整会作为新一轮优化的输入,持续改进云计算平台的资源配置。In step 18, the system will collect detailed information about the optimized resource configuration, including the specific amount of resources allocated to each node or service, and the current operating status data of the cloud computing platform (such as CPU usage, memory occupancy, network throughput, etc.); the collected data will be formatted into reports or charts that are easy for users to understand. This helps users intuitively understand the effect of resource optimization and the operating status of the cloud platform; according to user preferences and system configuration, select the appropriate communication protocol and method to send data to the user end, which may be through email, SMS notification, Web interface update, API call or other customized communication methods; send the formatted data to the user end as a monitoring signal. Users can evaluate the effect of resource optimization and the current performance and health of the cloud platform based on this information; after receiving the monitoring signal, users can provide feedback based on the actual situation, and may need to fine-tune the resource allocation plan to better meet business needs or performance requirements. These feedback and adjustments will serve as input for a new round of optimization to continuously improve the resource configuration of the cloud computing platform.

图2所示,本发明的实施例还提供一种基于云计算平台的业务监控系统20,包括:As shown in FIG2 , an embodiment of the present invention further provides a business monitoring system 20 based on a cloud computing platform, comprising:

获取模块21,用于获取云计算平台上各种资源和服务的使用情况数据;对云计算平台上各种资源和服务的使用情况数据进行自动化分析,以确定云计算平台的运行状态和性能指标;根据云计算平台的运行状态和性能指标,初始化一组粒子,每个粒子代表一种资源分配方案;The acquisition module 21 is used to acquire the usage data of various resources and services on the cloud computing platform; automatically analyze the usage data of various resources and services on the cloud computing platform to determine the operation status and performance indicators of the cloud computing platform; initialize a group of particles according to the operation status and performance indicators of the cloud computing platform, each particle represents a resource allocation scheme;

处理模块22,用于根据云计算平台上各种资源和服务的使用情况数据,以确定动态调整因子;根据预设的优化目标以及动态调整因子,计算每个粒子的适应度值;根据每个粒子的适应度值以及动态调整因子,更新每个粒子的速度和位置,以确定最终的资源分配方案,重复评估粒子适应度和更新粒子状态,直到达到预设的迭代次数,以得到最终的资源分配方案;根据最终的资源分配方案,自动调整云计算平台的资源配置,以得到优化后的资源配置和当前的运行状态;将优化后的资源配置和当前的运行状态,通过监控信号发送至用户端。The processing module 22 is used to determine the dynamic adjustment factor according to the usage data of various resources and services on the cloud computing platform; calculate the fitness value of each particle according to the preset optimization target and the dynamic adjustment factor; update the speed and position of each particle according to the fitness value of each particle and the dynamic adjustment factor to determine the final resource allocation plan, repeatedly evaluate the particle fitness and update the particle state until the preset number of iterations is reached to obtain the final resource allocation plan; according to the final resource allocation plan, automatically adjust the resource configuration of the cloud computing platform to obtain the optimized resource configuration and the current operating status; send the optimized resource configuration and the current operating status to the user end through the monitoring signal.

需要说明的是,该系统是与上述方法相对应的系统,上述方法实施例中的所有实现方式均适用于该实施例中,也能达到相同的技术效果。It should be noted that the system is a system corresponding to the above method, and all implementation methods in the above method embodiment are applicable to this embodiment and can achieve the same technical effect.

本发明的实施例还提供一种计算设备,包括:处理器、存储有计算机程序的存储器,所述计算机程序被处理器运行时,执行如上所述的方法。上述方法实施例中的所有实现方式均适用于该实施例中,也能达到相同的技术效果。The embodiment of the present invention further provides a computing device, comprising: a processor, a memory storing a computer program, wherein when the computer program is executed by the processor, the method described above is executed. All implementations in the above method embodiment are applicable to this embodiment and can achieve the same technical effect.

本发明的实施例还提供一种计算机可读存储介质,存储指令,当所述指令在计算机上运行时,使得计算机执行如上所述的方法。上述方法实施例中的所有实现方式均适用于该实施例中,也能达到相同的技术效果。The embodiment of the present invention also provides a computer-readable storage medium storing instructions, which, when executed on a computer, enable the computer to execute the method described above. All implementations in the above method embodiment are applicable to this embodiment and can achieve the same technical effect.

本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本发明的范围。Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统、装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

在本发明所提供的实施例中,应该理解到,所揭露的装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the embodiments provided by the present invention, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

另外,在本发明各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as USB flash drives, mobile hard disks, ROM, RAM, magnetic disks, or optical disks.

此外,需要指出的是,在本发明的装置和方法中,显然,各部件或各步骤是可以分解和/或重新组合的。这些分解和/或重新组合应视为本发明的等效方案。并且,执行上述系列处理的步骤可以自然地按照说明的顺序按时间顺序执行,但是并不需要一定按照时间顺序执行,某些步骤可以并行或彼此独立地执行。对本领域的普通技术人员而言,能够理解本发明的方法和装置的全部或者任何步骤或者部件,可以在任何计算装置(包括处理器、存储介质等)或者计算装置的网络中,以硬件、固件、软件或者它们的组合加以实现,这是本领域普通技术人员在阅读了本发明的说明的情况下运用的基本编程技能就能实现的。In addition, it should be noted that in the apparatus and method of the present invention, it is obvious that each component or each step can be decomposed and/or recombined. These decompositions and/or recombinations should be regarded as equivalent schemes of the present invention. Moreover, the steps of performing the above-mentioned series of processing can naturally be performed in chronological order according to the order of description, but it is not necessary to perform them in chronological order, and some steps can be performed in parallel or independently of each other. For those of ordinary skill in the art, it is understood that all or any steps or components of the method and apparatus of the present invention can be implemented in any computing device (including processors, storage media, etc.) or a network of computing devices in hardware, firmware, software or a combination thereof, which can be achieved by those of ordinary skill in the art using basic programming skills after reading the description of the present invention.

因此,本发明的目的还可以通过在任何计算装置上运行一个程序或者一组程序来实现。所述计算装置可以是公知的通用装置。因此,本发明的目的也可以仅仅通过提供包含实现所述方法或者装置的程序代码的程序产品来实现。也就是说,这样的程序产品也构成本发明,并且存储有这样的程序产品的存储介质也构成本发明。显然,所述存储介质可以是任何公知的存储介质或者将来所开发出来的任何存储介质。还需要指出的是,在本发明的装置和方法中,显然,各部件或各步骤是可以分解和/或重新组合的。这些分解和/或重新组合应视为本发明的等效方案。并且,执行上述系列处理的步骤可以自然地按照说明的顺序按时间顺序执行,但是并不需要一定按照时间顺序执行。某些步骤可以并行或彼此独立地执行。Therefore, the purpose of the present invention can also be achieved by running a program or a group of programs on any computing device. The computing device can be a well-known general device. Therefore, the purpose of the present invention can also be achieved by simply providing a program product containing a program code that implements the method or device. That is to say, such a program product also constitutes the present invention, and the storage medium storing such a program product also constitutes the present invention. Obviously, the storage medium can be any well-known storage medium or any storage medium developed in the future. It should also be pointed out that in the device and method of the present invention, it is obvious that each component or each step can be decomposed and/or recombined. These decompositions and/or recombinations should be regarded as equivalent schemes of the present invention. In addition, the steps of performing the above-mentioned series of processing can naturally be performed in chronological order according to the order of description, but it is not necessary to perform them in chronological order. Some steps can be performed in parallel or independently of each other.

以上所述是本发明的优选实施方式,应当指出,对于本技术领域的普通技术人员来说,在不脱离本发明所述原理的前提下,还可以作出若干改进和润饰,这些改进和润饰也应视为本发明的保护范围。The above is a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.

Claims (7)

1. The service monitoring method based on the cloud computing platform is characterized by comprising the following steps of:
acquiring service condition data of various resources and services on a cloud computing platform;
Carrying out automatic analysis on the service condition data of various resources and services on the cloud computing platform to determine the running state and performance index of the cloud computing platform;
Initializing a group of particles according to the running state and performance index of the cloud computing platform, wherein each particle represents a resource allocation scheme;
determining a dynamic adjustment factor according to the service condition data of various resources and services on the cloud computing platform;
calculating the fitness value of each particle according to a preset optimization target and a dynamic adjustment factor;
Updating the speed and the position of each particle according to the fitness value and the dynamic adjustment factor of each particle to determine a final resource allocation scheme, and repeatedly evaluating the fitness of the particle and updating the state of the particle until the preset iteration times are reached to obtain the final resource allocation scheme;
According to the final resource allocation scheme, automatically adjusting the resource allocation of the cloud computing platform to obtain the optimized resource allocation and the current running state;
And sending the optimized resource configuration and the current running state to the user side through a monitoring signal.
2. The cloud computing platform-based business monitoring method of claim 1, wherein automatically analyzing usage data of various resources and services on the cloud computing platform to determine operational status and performance indicators of the cloud computing platform comprises:
Screening relevant characteristics of the running state and performance index of the cloud computing platform from the service condition data of the resources and the services;
Determining the number K of clusters through an elbow rule according to the related features;
Clustering the service condition data of the resources and the services according to the number K of clusters, dividing the service condition data of the resources and the services into K clusters in the clustering process, wherein each cluster represents a similar running state until the preset iteration times are reached, so as to obtain a clustering result;
and determining the running state and performance index of the cloud computing platform according to the clustering result, wherein the running state and performance index comprise the average value or the median of each cluster.
3. The cloud computing platform-based traffic monitoring method of claim 2, wherein determining the dynamic adjustment factor based on usage data of various resources and services on the cloud computing platform comprises:
and according to the service condition data of various resources and services on the cloud computing platform, calculating a dynamic adjustment factor.
4. The cloud computing platform based traffic monitoring method of claim 3, wherein the usage data of resources and services comprises CPU usage, memory occupancy, network bandwidth, and storage usage.
5. A cloud computing platform-based business monitoring system, comprising:
the acquisition module is used for acquiring the service condition data of various resources and services on the cloud computing platform; carrying out automatic analysis on the service condition data of various resources and services on the cloud computing platform to determine the running state and performance index of the cloud computing platform; initializing a group of particles according to the running state and performance index of the cloud computing platform, wherein each particle represents a resource allocation scheme;
The processing module is used for determining dynamic adjustment factors according to the service condition data of various resources and services on the cloud computing platform; calculating the fitness value of each particle according to a preset optimization target and a dynamic adjustment factor; updating the speed and the position of each particle according to the fitness value and the dynamic adjustment factor of each particle to determine a final resource allocation scheme, and repeatedly evaluating the fitness of the particle and updating the state of the particle until the preset iteration times are reached to obtain the final resource allocation scheme; according to the final resource allocation scheme, automatically adjusting the resource allocation of the cloud computing platform to obtain the optimized resource allocation and the current running state; and sending the optimized resource configuration and the current running state to the user side through a monitoring signal.
6. A computing device, comprising:
One or more processors;
Storage means for storing one or more programs which when executed by the one or more processors cause the one or more processors to implement the method of any of claims 1-4.
7. A computer readable storage medium, characterized in that the computer readable storage medium has stored therein a program which, when executed by a processor, implements the method according to any of claims 1-4.
CN202410884313.1A 2024-07-02 2024-07-02 A business monitoring method and system based on cloud computing platform Pending CN118819843A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202410884313.1A CN118819843A (en) 2024-07-02 2024-07-02 A business monitoring method and system based on cloud computing platform

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202410884313.1A CN118819843A (en) 2024-07-02 2024-07-02 A business monitoring method and system based on cloud computing platform

Publications (1)

Publication Number Publication Date
CN118819843A true CN118819843A (en) 2024-10-22

Family

ID=93067885

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202410884313.1A Pending CN118819843A (en) 2024-07-02 2024-07-02 A business monitoring method and system based on cloud computing platform

Country Status (1)

Country Link
CN (1) CN118819843A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119697234A (en) * 2024-12-10 2025-03-25 龙思云(北京)科技有限公司 A connection resource scheduling method, cloud platform and electronic device

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104618269A (en) * 2015-01-29 2015-05-13 南京理工大学 Cloud system utilization rate maximized resource distributing method based on energy consumption requirements
CN110138612A (en) * 2019-05-15 2019-08-16 福州大学 A kind of cloud software service resource allocation methods based on QoS model self-correcting
CN113742049A (en) * 2021-11-08 2021-12-03 山东美欣医疗科技有限公司 Dynamic optimization and adjustment method for cloud virtualization resources
CN114490093A (en) * 2022-04-14 2022-05-13 北京计算机技术及应用研究所 Cloud resource optimal allocation method for multi-cloud management scene
US20220377615A1 (en) * 2021-05-18 2022-11-24 Microsoft Technology Licensing, Llc Techniques for adaptively allocating resources in a cloud-computing environment
CN117057840A (en) * 2023-08-21 2023-11-14 奇墨科技(广州)有限公司 Cloud resource cost optimization method and system
CN118101500A (en) * 2024-04-17 2024-05-28 西安电子科技大学 Service deployment method and system in edge environment based on improved genetic algorithm
CN118227312A (en) * 2024-01-15 2024-06-21 中国人民解放军国防科技大学 A data center resource scheduling method and system based on cloud computing

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104618269A (en) * 2015-01-29 2015-05-13 南京理工大学 Cloud system utilization rate maximized resource distributing method based on energy consumption requirements
CN110138612A (en) * 2019-05-15 2019-08-16 福州大学 A kind of cloud software service resource allocation methods based on QoS model self-correcting
US20220377615A1 (en) * 2021-05-18 2022-11-24 Microsoft Technology Licensing, Llc Techniques for adaptively allocating resources in a cloud-computing environment
CN113742049A (en) * 2021-11-08 2021-12-03 山东美欣医疗科技有限公司 Dynamic optimization and adjustment method for cloud virtualization resources
CN114490093A (en) * 2022-04-14 2022-05-13 北京计算机技术及应用研究所 Cloud resource optimal allocation method for multi-cloud management scene
CN117057840A (en) * 2023-08-21 2023-11-14 奇墨科技(广州)有限公司 Cloud resource cost optimization method and system
CN118227312A (en) * 2024-01-15 2024-06-21 中国人民解放军国防科技大学 A data center resource scheduling method and system based on cloud computing
CN118101500A (en) * 2024-04-17 2024-05-28 西安电子科技大学 Service deployment method and system in edge environment based on improved genetic algorithm

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119697234A (en) * 2024-12-10 2025-03-25 龙思云(北京)科技有限公司 A connection resource scheduling method, cloud platform and electronic device

Similar Documents

Publication Publication Date Title
US6622221B1 (en) Workload analyzer and optimizer integration
CN106020715B (en) Storage pool capacity management
US9021200B1 (en) Data storage system with predictive management of physical storage use by virtual disks
CN111722806B (en) Cloud disk allocation method, device, electronic device and storage medium
CN116662010B (en) Dynamic resource allocation method and system based on distributed system environment
US9122739B1 (en) Evaluating proposed storage solutions
US20110167149A1 (en) Internet flow data analysis method using parallel computations
CN118247016B (en) Cross-border e-commerce platform information interaction management method and system
US20260079768A1 (en) Modeling cloud inefficiencies using domain-specific templates
CN118467180B (en) A multi-tenant data management method
WO2012142144A2 (en) Assessing application performance with an operational index
CN118885291A (en) Real-time CPU load balancing method and system for cloud computing platform based on reinforcement learning
CN119248490B (en) Intelligent computing power scheduling method and system based on dynamic programming
CN120276873B (en) Load balancing method, load balancing device, electronic equipment, storage medium and program product
Naskos et al. Cloud elasticity using probabilistic model checking
CN118819843A (en) A business monitoring method and system based on cloud computing platform
CN120750878A (en) Soft switching resource flexible scheduling method, device, equipment and medium of cloud primary architecture
CN120528933A (en) Storage resource allocation method, storage medium, and electronic device
CN118394497A (en) Data processing method, device and system
CN114629909A (en) Cloud resource cost analysis method
CN118096246A (en) Enterprise portrait system and method
CN113177060A (en) Method, device and equipment for managing SQL (structured query language) statements
CN121092322A (en) Resource scheduling optimization method based on digital twin
CN119676756A (en) Intelligent management method of portable WIFI based on reinforcement learning and portable WIFI
CN119420658A (en) A method and system for managing internet resources

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination