Edit File: lvectllib.cpython-37.pyc
B 5/9e�x � @ s� d dl mZ d dl mZ d dl mZ d dlmZ d dlmZmZ d dl m Z m Z d dl m Z mZmZmZmZ d dlZd dlZd dlZd dlZd dlZd dlZd dlZd dlZd dlZd dlZd dl Z d dl m m Z d dl!Z!d d l"m#Z# d dl$Z$d dl%Z%d d lm&Z& d dl'Z'd dl(Z(d d l)m*Z* d d l+m,Z,m-Z-m.Z.m/Z/ d d l0m1Z1 d dl2Z2d dl3m4Z4m5Z5 d dl6m7Z7 d dl8m9Z9m:Z:m;Z; d dl<m=Z=m>Z> d dl'm?Z?m@Z@mAZAmBZBmCZC d dlDmEZE d dlFmGZG dZHdZIdZJdZKdZLdZMdZNd ZOd ZPeQejR�Sd d ��ZTd ZUe/e*jV��sdZWdZXne@eTd �ZWe?eWd!�ZXd"d#� ZYd$d%� ZZd&d'� Z[e1d(�d)d*�Z\�dd+d,�Z]d-d.� Z^d/d0d/d1d d2d d3d4�Z_d2Z`d5d0d d d d d d d4�Zad6d7d8d9d:d;d<d=gZbd>acdaddaed?afd?agi ahd?aid?ajd?akd?ald?amd?and?aod@apd?aqd?ard?asdAdB� ZtdCdD� ZudEdF� Zv�ddGdH�ZwdIdJ� ZxdKdL� Zyex� �p(ey� Zz�ddMdN�Z{dOdP� Z|dQdR� Z}dSdT� Z~�ddUdV�ZdWdX� Z�ej�dYdZ� �Z��dd[d\�Z�d]d^� Z��dd_d`�Z�dadb� Z�dcdd� Z��ddedf�Z�dgdh� Z�didj� Z�dkdl� Z�eQe�dm�dndo�Z�dpdq� Z�drds� Z�e e�eQf dt�dudv�Z�dwdx� Z��ddzd{�Z�d|d}� Z��dd~d�Z��dd�d��Z�d�d�� Z�d�d�� Z�d�d�� Z��d d�d��Z��d d�d��Z�d�d�� Z�d�d�� Z�d�d�� Z��d d�d��Z�d�d�� Z��d d�d��Z�d�d�� Z�d�d�� Z�d�d�� Z�d�d�� Z�d�d�� Z�d�d�� Z�d�d�� Z��d d�d��Z�e�fd�d��Z��d!d�d��Z�d�d�� Z�d�d�� Z�d�d�� Z�d�d�� Z��d"d�d��Z�d�d�� Z�d�d�� Z�d�d�� Z�d�d�� Z�d�d�� Z�d�dÄ Z�d�dń Z�d�dDŽ Z�d�dɄ Z�d�d˄ Z�d�d̈́ Z��d#d�dτZ�d�dф Z��d$d�dӄZ��d%d�dՄZ��d&d�dׄZ�e�e�eeQ dd�dڄZ�d�d܄ Z�d�dބ Z�d�d� Z�d�d� Z�d�d� ZƐd'd�d�Z�d�d� Z�d�d� Z�d�d� Zʐd(d�d�Z�d�d� Z�d�d� Z�d�d� Z�da�da�da�da�da�d�d�� ZԐd)d�d��Z�d�d�� Zd*d�d��Z�d�d�� Zؐd �d� Zِd�d� Zڐd�d� Zېd�d� Zܐd�d � Zݐd �d � Zސd �d � Zߐd�d� Z�d�d� Z�dS (+ � )�print_function)�absolute_import)�division)�range)� basestring�unicode)� iteritems�reraise)�Dict�List�Tuple�Optional�TextN)�partial)�PAGESIZE)�Feature)�admins�reseller_users�get_main_username_by_uid�is_panel_feature_supported)� EncodingError)� reseller_limits_disabled_post� reseller_limits_enabled_post)� exec_utility)�get_xml_config�save_xml�BadVeConfigException)�setup_global_lock�LockFailedException)�Lve�PyLve�LVP_XML_TAG_NAME� PyLveError�NameMap)�detect_panelclass)�write_file_via_tempfilez%/usr/bin/getcontrolpaneluserspackagesz /proc/cpuinfoi' Z VE_DEFAULTFz /bin/umountz"/etc/container/exclude_mounts.conf�multiZsingleZ PYLVE_DEBUG�plesk_id)�debug)�pyc C s t �� rt j�� S g S dS )z-Helper function for easy mocking in unittestsN)�lve�reseller_limit_supported�procZ lvp_id_list� r- r- � lvectllib.py�lvp_listN s r/ c C s t � } | �� | �� S )zf Get list of resellers with activated reseller limits :return: list of pairs (name, uid) )r# � link_xml_nodeZload_from_node)�name_mapr- r- r. �get_active_resellersV s r2 c C s | dd� t � D �kS )z] Check whether giver reseller has activated reseller limits or not :return: bool c s s | ]\}}|V qd S )Nr- )�.0�name�uidr- r- r. � <genexpr>f s z,is_active_reseller_limits.<locals>.<genexpr>)r2 )� reseller_namer- r- r. �is_active_reseller_limitsa s r8 )�ec C s> t �� st| � tr(tddt| �g� nt| � t�d� dS )a" Since cPanel user can corrupt config file for some user with wrong encodings, we want to notify him that he should fix encoding problems with the link to documentation. Print error message and exit with code 1 or raise given exception if it isn't cPanel. :return: None r& �ERROR� N) � cldetectlib� is_cpanelr �JSON� json_format�str�print�sys�exit)r9 r- r- r. �raise_cpanel_encoding_errorj s rD c C s0 y t | � W n tk r* tdd� Y nX dS )az ~~~~~~~~~~~~~~~~~~ !!! DEPRECATED !!! ~~~~~~~~~~~~~~~~~~ Please, use setup_global_lock instead if possible Wrapper over setup_global_lock. If lock cannot be set, it will write message and close app The only reason why it is here is legacy function check_result_and_exit that we use in TWO places :type write: bool :return: Nothing r; zcan`t get lockN)r r �check_result_and_exit)�writer- r- r. �get_global_lock| s rG c C sN | t j krJ| dkrJtr0ttddt|� g� ntdt|� � t�| � d S )Nr r: z lvectl: %szlvectl: Error: ) �errnoZENOSYSr> r? � MULTI_FORMATr@ rA rB rC )�result�messager- r- r. rE � s rE � r; � i i )�cpu�ncpu�io�ep�mem�pmem�nproc�iops�d rO rN rP rR rS rT rU rQ � � �falsec C s | a d S )N)r> )Z json_flagr- r- r. �set_json� s rZ c C s | a d S )N)� BYTES_FLAG)Z bytes_flagr- r- r. � set_bytes� s r\ c C s� t rtdkrd} n tdkr d} ntdkr.d} nd} ddd d d d d gddd d d d d dgddd d d d d gddd d d gd�| }tr�|�d�d }|d |� dg ||d � S |S )N� �noiops_8�8� �6�4�ID�SPEED�PMEM�VMEM�EP�NPROC�IO�IOPS)r^ r_ ra rb r; �CPU)�NOIOPS� LVE_VERSIONr> �index)�version�fieldsZ speed_idxr- r- r. � get_fields� s rq c C sR | d kr.t �� } | d d kr$td��| d an| at�� }|sFtd��t�� ad S )Nr zget_lve_version failedzinit_lve() failed.)�clcommonZget_lve_version� Exceptionrm �pylve� initialize�liblve_settings� lve_settings)Zlve_verZ lve_statusr- r- r. �init� s rx c C sf t j�d�} | dkrdS y t�| �S ttfk r` } z tdt|�� t � d� W dd}~X Y nX dS )z-Get cpu information from environment veriableZCPU_DATANz.Invalid environment variable 'CPU_DATA' formatr; ) �os�environ�get�json�loads� TypeError� ValueErrorrA r@ rB rC )Zpacked_cpu_datar9 r- r- r. �_get_cpu_data_from_env s r� c C s� i } i }d}yt td�}W n2 tk rL tdtt� d � t�d� Y nX x||D ]t}|�� sz|| d| < |d }i }qTt|� d��dkr�|� d�d �� ||� d�d �� < qTd ||� d�d �� < qTW || d d gS ) zF Parse /proc/cpuinfo return [NumProc, frequency in MHZ] r �rzlvectl: Error: Can`t open �.r; zproc%s�:� rX Zproc0zcpu MHz) �open�CPUINFO�IOErrorrA r@ rB rC �strip�len�split)ZcpuinfoZprocinfoZnprocs�f�liner- r- r. � get_cpu_data s" &r� c C s� t | �} |pd}t}t|d �}t�d| �}|dk r~t| �} | dkr~| dkr~tttd | | ��}|dkrp|S t|t |�S dS )z� Try converting to kernel format from old CPU format (percentage of whole cpu) and optionally the NCPU format. Return whichever is less. :param data: string presumably in old CPU format :param lncpu: integer number of cores limit r z \d{1,2}0?$NrV )r@ � CPUINFO_DATA�int�re�match�round� CORE_WEIGHT�min)�data�lncpu�cpu_datarO Z cpu_percentZfrom_cpu_limitr- r- r. �convert_from_old_cpu8 s r� c C st t | �} t}t|d �}t�d| �}|dk rpt| �dd��}||d krP|d }|dkrltttd | ��S dS dS )zd Try converting cpu limit from SPEED in percentage of one CORE format to kernel format. r z\d+(?:\.\d+)?%$N�%rX rV ) r@ r� r� r� r� �float�replacer� r� )r� r� rO Zpercentr- r- r. �convert_from_speed_percentN s r� c C s� t | �} t}t|d �}t|d �}t�dtj�}|�| �}|dk r�|�d�}t|�d��}|� � dkrp|d }||| kr�|| }|dkr�tt |t | ��S dS ) zQ Try converting cpu limit from SPEED in mhz/gzh format to kernel format. r r; z,(?P<freq>\d+(?:\.\d+)?)(?P<suffix>mhz|ghz)+$N�suffix�freqZGHZi� ) r@ r� r� r� r� �compile� IGNORECASEr� �group�upperr� r� )r� r� rO Zcpu_freq�patternr� r� r� r- r- r. �convert_from_speed_hz` s r� c C s t | �pt| �S )z} Try converting cpu limit value from either SPEED limit format (percentage of CORE or mhz/ghz) to kernel format. )r� r� )r� r- r- r. �convert_from_speedu s r� c C sB t | |�}|dk r|S t| �}|dk r*|S t| �}|dk r>|S dS )z� Convert different variants of cpu limit to kmod ver 8 variant :param data: Value in old CPU format or SPEED with % or mhz/ghz. :param lncpu: Limit in old NCPU format. :return: CPU limit in kmod ver 8+ format or None for bad format N)r� r� r� )r� r� Zfrom_cpuZfrom_speed_percentZ from_speed_hzr- r- r. �convert_to_kernel_format s r� c C s^ t }t|d �}t| �} d| krBdtttt| �d��| ��� S tttt| �| ���S dS )zm convert speed to old cpu format args: cpu limit in speed value return: old cpu limit format r �*N)r� r� r@ r� �lstrip)�speedr� rT r- r- r. �speed_to_old_cpu� s "r� c c sf t �� t �� }yt �|| � W n( tk rH t�tjd| � � Y nX z |V W dt �|� X dS )zF Run subprocess in lve with pseudo-random id and given limits zKUnable to setup lve with id %i, something is wrong, check dmesg for detailsN)rt ru Zget_available_lve_id� lve_setupr" �syslog� LOG_ALERT� lve_destroy)Zsettings�lve_idr- r- r. � temporary_lve� s r� c C sJ t �� }t| |d�|_||_||_||_||_tt � d| t ��|_ |S )a Just a nice user-friendly constructor of liblve_settings object You can pass the following ls_cpu and ls_cpus values: - in percents of one core (just ls_cpu='75%', ls_cpus will be ignored) - in old 'CPU' format (two arguments, ls_cpu and ls_cpus required, both int) )r� g �?) rt rv r� �ls_cpu�ls_io� ls_enters�ls_nproc�ls_iopsr� �mathZceilr � ls_memory_phy)r� �ls_cpusr� r� r� r� r� �sr- r- r. �make_liblve_settings� s r� c C s0 t | �d��}|s(| �d�}t�|�j}t|�S )N�id�user)r@ � getAttribute�pwd�getpwnam�pw_uidr� )�ve_lve_elementZuser_uidZ user_namer- r- r. �get_ve_lve_user_uid� s r� c C sL dt |d �i}| tkr(t |d �|d< |dk r:|�|� tt�|�� dS )a� Print output in json as: {"status": "ERROR/OK", "msg": "Some Message", "ext1": "foo", "ext2": "bar"} where "status" and "msg" field are mandatory :param str error_type: Either MULTI_ERROR or SINGLE_ERROR :param list data: List with a status string and a message string :param dict extensions: Some additional fields for the final json object :return: None Zstatusr r; �msgN)r@ rI �updaterA r| �dumps)Z error_typer� � extensionsrJ r- r- r. r? � s r? c C s� y t t�|�d �d��||< W n` tttfk r� || ||< |�|�}|�dt || �� y| � |� W n Y nX Y nX d S )Nr �limit) r� � ve_default�getElementsByTagNamer� r � IndexErrorr~ � createElement� setAttributer@ � appendChild)�xml� ve_defaults�ve_cfg�val�default�noder- r- r. �check_def_value� s r� c s � fdd�| j D �S )Nc s& g | ] }t |tj�r|j� kr|�qS r- )� isinstancer� ZElementZtagName)r3 �_)�tagr- r. � <listcomp>� s z"xml_filter_tag.<locals>.<listcomp>)Z childNodes)r� r� r- )r� r. �xml_filter_tag� s r� c C sF x@t | |�D ]2}|d k r$|�|�s$q |d k r<|�|�|kr<q |S W d S )N)r� Z hasAttributer� )r� r� �attrZattr_valZ child_noder- r- r. �xml_filter_first� s r� c C s& t | ||d�}|d kr t� �|�|�S )N)r� r� r� )r� r� r� )r� r� r� Zfiltered_child_noder- r- r. �get_child_tag_atrr s r� c C s" t | |�d }|�|t|�� dS )z� Find in children nodes node with tag and setup attribute insted el.getElementsByTagName not search recursiveli in tree r N)r� r� r@ )r� r� r� r� Zfirst_child_noder- r- r. �set_child_tag_atrr s r� c C sd yt � \aaW nP tk r^ } z2tr8ttdt| �g� n tt| �� t � d� W dd} ~ X Y nX dS )zLoad config from ve.cfgr: r; N) r r� � ve_lveconfigr r> r? rI r@ rA rB rC )r9 r- r- r. �_load_config_wrapper s r� )�lvp_id� lvp_defaultsc C s� da y\| s ttd�d atS |r.t�d�atS ttt dt | ��}|rT|� d�d an t� t�atS t k r� tr�tdddg� t�d� ntd � Y nX tS ) z�Load default limits :param int lvp_id: lvp id :param bool lvp_defaults: load reseller's default limits instead of global :return: dict with default limits �true�defaultsr r� r& �WARNINGz default section error in ve.cfgr; z(warning: default section error in ve.cfg)�ubcr� r� r� � LVE_DEFAULTr� r� � LVP_DEFAULTr� r! r@ r� Z cloneNoder� r> r? rB rC rA )r� r� Zdefaults_root_noder- r- r. �_load_default_limits s& r� c C s t dd� ttttttfD ��S )Nc s s | ]}|d kV qdS )rX Nr- )r3 �xr- r- r. r6 G s z._all_config_elements_loaded.<locals>.<genexpr>)�all�ve_lve�ve_lvp� ve_package� ve_binary�ve_enter_by_name�ve_cfg_versionr- r- r- r. �_all_config_elements_loadedF s r� c C s� t �d�at �d�at �t�atjj� t � t �d�} t | �dkrL| d a nt � d�a t �t � t �d�at �d�}t |�dkr�t|d jj�ndadS ) z$Load all config elements from ve.cfgr* �packagez enter-by-namer �binaryro r; N)r� r� r� r� r! r� r* �mapr1 r0 r� r� r� r� r� r� r� Z firstChildZ nodeValuer� )Zenter_by_name_elemsZcfg_version_elemsr- r- r. �_load_config_elementsI s r� )�default_limitsc C s� i a ttdtt t| d�}|dd� y,t�d�d �d�}t|t d d�t d< W nl tt t fk r� t| d t d d�t d< t� d�}|� dt | d �� yt�|� W n Y nX Y nX y tt�d �d �d ��t d < W nb tt t fk �r> | d t d < t� d �}|� d t | d �� yt�|� W n Y nX Y nX |d d� td k�r^|dd�n|ddtid� |dd� |dd� |dd� t� dS )z~Create ve_defaults dict with default values for all limits :param dict default_limits: default limits for lve or lvp N)r� r� r� r� r� rO )r� rN r r� )r� �other� maxentryprocsrQ rP � rR )r� r� rS rT rU )r� r r� r� r� r� r� r� r r� r~ r� r� r@ r� r� rm �MEM_DEFAULT_CL5�_check_defaults_for_nones)r� Z check_def_valr� rN rQ r- r- r. �_load_ve_defaultsn s> $ r� c C s` xZt �� D ]N\} }|dk r q d| � d�}tr<tdd|g� ntj�|� d�� t�d� q W dS )z*Check that all default values are not NoneNzERROR: Incorrect z default valuer& r: � r; )r� �itemsr> r? rB �stderrrF rC )�key�value�err_msgr- r- r. r� � s r� Tc C s, t � t| |�}|st� s t� t|� dS )z� :param bool lvp_defaults: load reseller's default limits instead of global :param int lvp_id: lvp id to load customise defaults N)r� r� r� r� r� )r� r� �load_config_elementsr� r- r- r. � get_XML_cfg� s r c C sF y t t|| dd��}||| < |S tttfk r@ t || �S X d S )Nr� )r� r� )r� r� r r� r~ )r� �elr� � setup_datar r- r- r. � check_value� s r c C s* t �� }|�� |�| �}t||d� dS )a5 This function is a pure workaround for our ugly globals-based API which should be fixed partially with LU-496, because there is no clean way to retrieve reseller's data from ve.cfg without touching globals :param reseller: reseller name :return: Nothing. It just updates some globals )r N)�lveapir# r0 Zget_idr )�reseller�xml_config_load_elementsr1 Z reseller_idr- r- r. �_load_resellers_xml_data� s r c s� t � t�a� dk �r�t� }�dk rF�|krF� |� krF� �fdd�}n�t�� r�|dk r�y8t�|�}d|j� d�}t |��}|� � }W dQ R X W n t k r� d}Y nX d|kr�t � t j d�|d �� � fd d�}x�tD ]�} || �r�td | tt�} y&ttt| d d d�| d��} | td < W n tttfk �r4 Y nX td| tt� tdk�r^td| tt� ndtd< y tt| ddd��} | td< W n tttfk �r� Y nX td| tt� td| tt� td| tt� q�W dS )a Put limit values that will be applied later in a global variable `setup_ve`. :param plan_id: package :param reseller: If reseller is None we only inherit from admin packages. In that case we ignore all tags in ve.cfg with a "reseller" attribute. Nc s | � d�� ko| � d��kS )Nr� r )r� )r )�plan_idr r- r. �<lambda>� � z$prepare_setup_data.<locals>.<lambda>z"/usr/local/directadmin/data/users/z /user.confrX zpackage=customzNPackage for user with id {} is incorrect, please recover it using Note from {}zYhttps://docs.cloudlinux.com/cloudlinux_os_components/#installation-enabling-and-disablingc s | � d�� ko| � d� S )Nr� r )r� )r )r r- r. r � r rO rN r� )r� r� )r� rP r� rR r r� r� rQ rT rS rU )�copyr� r �get_reseller_packages_mapr< �is_dar� �getpwuid�pw_namer� �readrs r� r� �formatr� r r� r� r� r r� r~ r� ) r r r� Z res_pkg_dict�is_needed_planZuser_pwd�filenamer� �textr r� rN rQ r- )r r r. �prepare_setup_data� sP r c C sZ y,t jtd| gt jt jd�}|�� |jdkS tk rT tddtd| f � Y nX d S )Nz-l)�stdoutr� r ���zfailed to run "%s %s %s")� subprocess�Popen�UMOUNT�PIPEZ communicate� returncode�OSErrorrE )�path�pr- r- r. � umount_dir s r$ c C sB t j�t�sdS g } yDttd��0}x(|D ] }|�� }|r(| �t�|�� q(W W dQ R X W n" t k rz t ddt � Y nX | s�dS t � t j � y,tdd��}dd� |� � D �}W dQ R X W n" tt fk r� t dd� Y nX d }xXt|�D ]L}d }x<|D ]4} x.| D ]&} | �| �} | �rt| ��p&|}P �qW q�W |s�P q�W dS ) zy Unmount all paths from /proc/mounts that match regular expressions from /etc/container/exclude_mounts.conf file Nr� r zfailed to read %sz /proc/mountsc S s g | ]}|� � d �qS )r; )r� )r3 �mr- r- r. r� 6 s z"prepare_mounts.<locals>.<listcomp>z failed to parse /proc/mounts� F)ry r" �isfile�EXCLUDE_MOUNTS_CONFr� r� �appendr� r� r� rE �unshareZ CLONE_NEWNS� readlinesr� r �searchr$ ) Z reg_exp_listZconfr� r� r� ZmountsZATTEMPTSr� �errorZmountZreg_expr% r- r- r. �prepare_mounts" s< " r. c C sN d} yt j| ddd� W n tk r6 td| � Y nX t� tjdd� dS ) zI Start LVE engine and initialize default mount namespace for LVE z,/bin/mount --make-rprivate / >/dev/null 2>&1Tz /bin/bash)�shell� executablezError: failed to executez Can`t init lve default settings)r N)r Zcallr! rA r. rt � lve_start)Z MOUNT_CMDr- r- r. r1 F s r1 c C s t j| d�| �|d� dS )zs Create LVE container for given ID :type lve_id: int :type ignore_error: bool :return: Nothing z8lvectl: Can`t create lve with id {}; error code {{code}})r � ignore_errorN)rt � lve_creater )r� r2 r- r- r. r3 S s r3 c C s t j| d�| �|d� dS )zs Create LVP container for given ID :type lvp_id: int :type ignore_error: bool :return: Nothing z8lvectl: Can`t create lvp with id {}; error code {{code}})r r2 N)rt Zlve_lvp_creater )r� r2 r- r- r. � lvp_create_ s r4 c C s8 t � } x,t� D ]"}tj|d�|�d� | �|� qW | S )Nz9lvectl: Can`t destroy lvp with id {}; error code {{code}})r )�listr/ rt �lve_lvp_destroyr r) )Zdestroyed_listr� r- r- r. �destroy_lvp_allk s r7 c C s( | dkrt � ntj| d�| �d� d S )Nr� z9lvectl: Can`t destroy lvp with id {}; error code {{code}})r )r7 rt r6 r )r� r- r- r. � lvp_destroyt s r8 c C s� d� | �}d� | �}d}| dkrvt�� r2tt� �}tttj�� ��dkrpx*tj�� D ]}tj ||d� d}qTW q�d}nJtj� | �s�tj� � r�tj� | �d k r�tj | |d� d}ntj� | �s�d}|r�t r�ttdg� n"t r�ttd |g� ntd � |�� d S ) Nz/Can't remove lve {} from kernel - error code -3z1Can`t destroy lve with id {}; error code {{code}}Fr� r )r TZOKZWARNz warning: {})r r* r+ �boolr7 r� r5 r, � lve_id_listr� Zcheck_inside_listZresellers_supported�detect_inside_lvpr> r? � SINGLE_FORMATrI rA )r� Zcant_remove_msgZcant_destroy_msgZ destroyedZid_r- r- r. r� } s0 r� c C sp |rt j�|�st|� t�� ��D t�d� y�ttd �t _ ttd �t _ ttd �t _ ttd �t _ ttd �t _tdkr�ttd �t _ttd �t _td kr�ttd �t _|r�| d kr�tj|t d �|�d� ntj|t d�|�d� n0| d k�rtjt dd� ntj| t d�| �d� W nB tk �r` } z"tddt| � d t|� � W d d }~X Y nX W d Q R X d S )Nr- rP rN rO rR rQ r� rS rT r` rU r z&Can`t setup default settingsfor LVP {})r z/Can`t setup lvp with id {}; error code {{code}}z Can`t setup default settingsz/Can`t setup lve with id {}; error code {{code}}r; zCan`t setup lve z. RuntimeWarning excepted: )r* r, � exist_lvpr4 �warnings�catch_warnings�filterwarningsr� r rw r� r� r� Z ls_memoryr� rm r� r� r� rt �lve_set_defaultr Z lve_lvp_setupr� �RuntimeWarningrE r@ )r� r� Zrwr- r- r. r� � s6 r� c C s� d}d}t }td� t }|a t|t�r�y|| d }|s<d}W n tk rV d}Y nX y|| d }|snd}W n tk r� d}Y nX ||fS )z� Get pair of package, reseller for lve_id :param lve_id: lve_id, UID with package, reseller :return: tuple of (package, reseller); Both can be None Nz list-usersr r� )�packages_users�GetControlPanelUsersr� �dict�KeyError)r� r� r �old_packages_usersZ temp_packager- r- r. �"get_package_and_reseller_by_lve_id� s( rH c s t }� dkr td� � t | }a tdkr2t|d� d}|dk rD|}n$|rLtnt} tt� fdd�| �d�}|dkr�y|� d }W n tt fk r� d}Y nX y|� d }W n tt fk r� d}Y nX |dk �r�t ||d � t d |t t �} y tt|d d d�| d�t d < W n tttfk �r* Y nX t d dk�rFt d t d < t d|t t � tdk�rnt d|t t � ndt d< ytt|ddd��t d< W n tttfk �r� Y nX t d|t t � t d|t t � t d|t t � n t ||� d� tdk�r�dt d< |�s t� |d� dS )a Aplly limits to LVE lve_id :param lve_id: lve id :type lve_id: int :param plan_id: package for user with lve_id. deprecated :type plan_id: string :param result: if True = don't apply limits. only create setup_data with actual limits :type result: boolean :param reseller: if True = plan_id is resellers plan. deprecated :type reseller: boolean :param out_node: node with limits for lve_id :type out_node: xml_node :param lvp_id: reseller container id; host container if 0 r �useridrX )r� Nc s t | d�� kS )N)r� )r� )r� )r� r- r. r r zlve_apply.<locals>.<lambda>r� r )r rO rN r� )r� r� )r� rP r� rR r� r� rQ rT rS rU )r r� rY )rC rD r� r r� r� �next�filter� NameErrorrF r r r� r r� r� r r� r~ r� r� r� ) r� r rJ r �out_noder� rG Znew_packages_usersr � node_listr� r- )r� r. � lve_apply� s^ rO c C s t | � dS )a� Sometimes python is confused about which encoding we should use to print message. E.g. when we use "command | grep" to find something in the output. According to python docs, "Software should only work with Unicode strings internally, converting to a particular encoding on output." So let's convert all unicode into str using our "magic" byteify method :param string: :return: N)rA )�stringr- r- r. �_print_string_safeD s rQ c G s2 t d�dd� | dd� D �d| d g �� dS )zz Command to print data with only last column 30 symbols wide Useful to print data that contains package name. rX c S s g | ] }d | �qS )z%8sr- )r3 r� r- r- r. r� ] s z_pprint.<locals>.<listcomp>Nr z%30s)rQ �join)rp r- r- r. �_pprintX s rS c G s< t d�dd� | dd� D �d| d d| d g �� dS )z� Command to print data with two last columns 30 symbols wide. Useful to print full data of every user with package name and reseller name. rX c S s g | ] }d | �qS )z%8sr- )r3 r� r- r- r. r� e s z _pprint_f.<locals>.<listcomp>N���z%30sr )rQ rR )rp r- r- r. � _pprint_f` s rU c G s2 t d�d| d gdd� | dd� D � �� dS )ze Command to print data with first column 30 symbols wide. Useful to print packages data. rX z%30sr c S s g | ] }d | �qS )z%8sr- )r3 r� r- r- r. r� m s z _pprint_p.<locals>.<listcomp>r; N)rQ rR )rp r- r- r. � _pprint_ph s rV c G s@ t d�d| d gdd� | dd� D � d| d g �� dS ) z� Command to print data with first column and last column are 30 symbols wide. Useful to print data with user names and package names. rX z%30sr c S s g | ] }d | �qS )z%8sr- )r3 r� r- r- r. r� u s z _pprint_r.<locals>.<listcomp>r; r N)rQ rR )rp r- r- r. � _pprint_rp s rW c C sf t | �} t| �t tfkr&| �d�r&dnd}| �dd�} | rLt| �} | d9 } nd} |r^d�| �n| } | S )z� Convert pmem or vmem limits to bytes value :param value: pmem or vmem limits in kbytes value :return: bytes value of limit r� TFrX i r z*{})r@ �typer � startswithr� r� r )r � was_changedr- r- r. �_pmem_vmem_to_bytes_valuex s " r[ c C s� d}d}t | t�r,| �d�r,| dd� } d}y t| �}W n tk rL dS X |rVd}|d d } | d krxd �|| �}nd �||d �}|S ) z� Convert amount of RAM to M format :param string value: amount of memory in KB :rtype: string :return: amount of memory in MB like "1234M" rX Fr� r; NTrW i r z{}{}Mz{}{}K)r� r rY r� r r )r rJ rZ �vr- r- r. �_mb_mem� s r] �0r� c s t �� � � d d � d< � fdd�}|d�dkr<t|d��nd}dd� }|t|d��t|�t|d��t||d���t||d ���t|d ��t|d ��t|d ��t|d ��|d� �g }t� }|dk r�||7 }tr�d��fdd�|D ��} d| g}n | |� | �fdd�|D �� |S )z^ Generate header and default package data either as print to stdout or as json string rN rV c s � � | d�S )NrX )r{ )r )r� r- r. r � r z _formatter.<locals>.<lambda>rX c S s t r t| �S t| �S )N)r[ r[ r] )r r- r- r. r � s rO rS rR rQ rT rP rU ) rc rd rk ZNCPUre rf rg rh ri rj �PACKAGEN�,c 3 s" | ]}d |� � |d�f V qdS )z "%s":"%s"rX N)r{ )r3 r� )� fields_mapr- r. r6 � s z _formatter.<locals>.<genexpr>z{%s}c s g | ]}� � |d ��qS )rX )r{ )r3 r� )ra r- r. r� � s z _formatter.<locals>.<listcomp>)r� r r� r@ rq r> rR ) �printer� default_idZdefault_package� more_fields�get_dataZ_cpu�convert_mem_limits�resrp r� r- )r� ra r. � _formatter� s( rh c s � �fdd�}|S )aA Generate inner function with closured fields names and printer function :param list fields: List of strings that represent names of fields in final output :param callable printer: Function to format and print data for every entry :rtype: callable :return: function to format data for every user c s d� t | d }t | d }|dkr(d}tdkr>t|dd� n,|dk rTt|dd� n tdd � t||d� t�t�� t| ||d d � � fd d �}dd � }t| �� d< t|d��� d< t|d��� d< t||d���� d< t||d���� d< t|d��� d< t|d��� d< t|d��� d< t|d��� d< t �r@t |�� d< n|� d< |dk�rft �r\dnd� d< n|� d< d� d k�r�dtt � d � d��d � � d< nt � d �d � d< � d � d < tt � d ��� d< g }t �rd �� fd d ��D ��}d | g}n�� fd!d"��D �� |S )#z� :param string user: Find and format data for this User ID :rtype: list :return: List of given user's statistics data line or empty list rX r� r Nr; )r F)r )r T)r r rJ c s4 t � | �t t| �kr(dt t| � S t � | �S )Nr� )r@ r )r )r� r- r. r � s z2_user_formatter.<locals>.wrapper.<locals>.<lambda>c S s t r t| �S t| �S )N)r[ r[ r] )r r- r- r. r � s r� rN rO rS rR �vmemrQ rP rT rU zN/Ar� rV r� r` c 3 s" | ]}d |� |� � f V qdS )z "%s":"%s"N)�lower)r3 r� )r� r- r. r6 s z3_user_formatter.<locals>.wrapper.<locals>.<genexpr>z{%s}c s g | ]}� |� � �qS r- )rj )r3 r� )r� r- r. r� s z4_user_formatter.<locals>.wrapper.<locals>.<listcomp>)rC r� r r r r r rO r@ r> �_normalize_strr� r� r� rR )r� r� r Z check_changedrf rg r� )rp rb )r� r. �wrapper� sR $ z _user_formatter.<locals>.wrapperr- )rp rb rl r- )rp rb r. �_user_formatter� s Brm c C s� t � yBtd� | d k r(| r(td| � n |d k r>td|d� ntd� W n Y nX dg}tt|d�}t� | }t|�}xtD ]}|||�7 }q�W tr�tdd� |� d � d S ) Nz list-usersrI zlist-reseller-users)r r_ )rd z {"data":[r` z]}) r rD rh rS rq rm rC r> rA rR )rI r rd rJ rp � formatterr� r- r- r. �paneluserslimits s$ ro c C sB t d� g } x0tt�D ]$\}}| �t|�|d |d f� qW | S )z@Get list of tuples[lve_id, reseller, package] from control panelz list-usersr r� )rD r rC r) r� )rJ Zstr_uidZpayloadr- r- r. �paneluserslist3 s rp c C s> ddl m} i }td� tt�� �|| < td� |�t� |S )zBGet dict of pairs[provider, list[package_name]] from control panelr )�DEFAULT_PROVIDERz list-packageszlist-resellers-packages)Z clveconfigrq rD r5 rC �keysr� )rq �packagesr- r- r. �panelpackagesdict= s rt c C sp t � td� ttddgd�} t� ddg }t|td�}xtD ]}| ||�7 } q>W trltdd� | � d � d S ) z] Implements lvectl all-user-list command :return: None, prints result to stdout z list-usersr_ �RESELLER)rd )rb z {"data":[r` z]}N) r rD rh rU rq rm rC r> rA rR )rJ rp rn r� r- r- r. �all_users_limitsO s rv c s6 t �� dkr2dd� t� D �� � fdd�t| �D �} | S )z� Filtering DirectAdmin's admins for `lvectl apply all` command :param ve_dict: dict with LVE :return: filtering dict Z DirectAdminc S s g | ]}t �|�j�qS r- )r� r� r� )r3 r� r- r- r. r� n s z(_filtering_da_admins.<locals>.<listcomp>c s i | ]\}}|� kr||�qS r- r- )r3 r r )�uids_da_adminsr- r. � <dictcomp>o s z(_filtering_da_admins.<locals>.<dictcomp>)r< Z getCPNamer r )�ve_dictr- )rw r. �_filtering_da_adminsc s rz c s> y8t � tt�}| r6tjj�� � � fdd�t�� D �}W n t� }Y nX | dkr`t}t � }nt }tj j | d�}i }x |D ]}|d d�|t |d�< q|W x"|D ]}||kr�d d d�||< q�W t|�dk�r:t|�}xf|D ]^}||kr�d }n || d }|| }t|�} t| �dk�r(|| d d�||< q�|d d�||< q�W |S ) Nc s i | ]\}}|� kr||�qS r- r- )r3 �kr\ )�cfg_lvp_id_listr- r. rx { s z&prepare_apply_data.<locals>.<dictcomp>T)r� )r� r )r� r r� )rD rE rC r* r� r1 �id_listr� r� r/ r� r, r: r� r� rz �guess_reseller_by_package) r� Zpackages_users_rN r} ry r� r� r5 Zpkg� resellersr- )r| r. �prepare_apply_datat s> r� c C sx t � td� t� } t�� r(tt�� �ni }tjjdd��F x>| � � D ]2}|� |d�dkrFt || | d | | d d� qFW W d Q R X t dd� t�� s�d S td�} tj � � }x�| � � D ]�}t |dd d � t || | d | | d |d � t |d d � t d|d � tj �|�}x`tj�|�D ]P}t�|�j}|� |d�|k�r^tjj||d|� d|� d�d� t ||d� �q W q�W d S )Nz list-usersT)r2 r r� r )rM r )r� F)r� r� r )r� rM r r� )r� r )r� r� zCan`t move lve_id=z to lvp_id=z; error code {code})r )r� r )r rD r� r* r+ rE Zlve_id_lvp_id_pairsr) Zcontext_ignore_errorrr r{ rO r, r� �get_reseller_namerr Zcpapir r� r� r� � lve_lvp_move)ry Z lve_lvp_mapr� Zkernel_mappingZlvp_id_r7 r� �lve_id_r- r- r. � lve_apply_all� s< , r� c C s� t d� t| d� x�tD ]�}t|d�| krtj�| �}xd|dd� D ]T}t�d|� yt � |� W qD t k r� tj � |�r�t�|� |�|� Y qDX qDW t| � |j�|� tt� tdd� x|D ] }t|� q�W t| d� dS qW dS )z,Remove reseller from ve.cfg and from procfs.T)r� )r� Nr F)rG r r� r� r* r, Zmap_lve_id_listrt r� r� r rF r) Z lve_existsr� �remover8 � parentNode� removeChildr r� rO )r� r �usersr� r- r- r. �_remove_reseller� s, r� c C sH t |�rtj| d� n.tr8tddd| g� t�d� n td| � dS )z&Disable reseller limits and call hooks)r r& r� z!no configuration found for LVP %sr z*warning: no configuration found for LVP %sN)r� r � throw_eventr> r? rB rC rA )r7 r� r- r- r. �disable_reseller_limits� s r� c C s� t d� t� d}xPtD ]H}t|d�| krd}t| � t| � |j�|� tt � t� t | � qW |s�t r�t ddd| g� t �d� n td| � d S ) NTF)r� r& r� z no configuration found for VE %sr z)warning: no configuration found for VE %s)rG r r� r� r� r3 r� r� r r� rO r> r? rB rC rA )r� �Deletedr r- r- r. � lve_delete� s" r� c C s6 t j�d�s2tr tdddg� ntd� t�d� d S )Nz/proc/lve/enterr& r� zenter by name not supportedz$warning: enter by name not supportedr )ry r" �existsr> r? rA rB rC r- r- r- r. �lve_enter_check s r� c C sD t � y,| |�� }tdd�}|�|� |�� W n Y nX d S )Nz/proc/lve/enter�w)r� r� r� rF �close)Zsignr� r� r� r- r- r. � enter_apply s r� c C s� t � trfd} d}x@tD ]8}|�d�}|r@| d| d 7 } d}q| d| d 7 } qW | d7 } t| � n$td� xtD ]}t|�d�� qtW d S ) Nz {"data":[Tr" �"Fz,"z]}ZBinaries)r r> r� r� rA )rJ �firstr r" r- r- r. � list_binaries( s r� c C s( t � x tD ]} td| �d�� q W d S )N�+r" )r r� r� r� )r r- r- r. � load_binaries< s r� c C sB t � tdd�} | �� }| �� x|D ]}td|� q&W t� d S )Nz/proc/lve/enterr� �-)r� r� r+ r� r� r� )r� �lines�lr- r- r. �reload_binariesB s r� c C s� t d� t� t� d}xBtD ]:}|�d�| kr d}td| � |j�|� tt � t� q W |s�t rxt ddd| g� n t d| � t �d � d S ) NTFr" r� r& r� z no configuration found for %sz&warning: no configuration found for %sr )rG r� r r� r� r� r� r� r r� r> r? rA rB rC )r� Zdeletedr r- r- r. � del_binaryL s r� c C sj t d� t� x tD ]}|�d�| krd S qW td| � t�d�}|�d| � t� |� t t� t� d S )NTr" r� r� ) rG r r� r� r� r� r� r� r� r� r )r� r Zbin_xmlr- r- r. � set_binarya s r� c sF y4|r t }n|rt}nt}� �fdd�|D �d }W n tk rH dS X |r�xB�d D ]6}|dkrrt|dd�}n t||d �}|rX|j�|� qXW dS tt��d }xz|D ]r} | dkr�t |� d��dkr�| �kr�|� d�d � d��| < q�t |� | ��dkr�| �kr�|� | �d � d ��| < q�W |�r6t �d � n t �d � dS ) a� Set given lve or package to default values for given parameters :param dict set_data: Arguments of lvectl call :param bool package_flag: Should we delete package or lve with given id :param callable is_needed: Function that takes xml element and set_data dict and returns whether current xml element contains info about needed ID from set_data c s g | ]}� |��r|�qS r- r- )r3 r9 )� is_needed�set_datar- r. r� � s z#lve_set_default.<locals>.<listcomp>r Nz set-defaultrQ r� r� r� �ve_id)r� r� r� r� r� r� r� �set�LIMITS_LIST_NAMEr� r� r� � plan_deleter� ) r� � package_flagr� r� r� r Ztag_�nZto_keepr� r- )r� r� r. rA q s8 rA c C sN |dkr dS t | �}|dkr dS y t|�}W n g }Y nX ||krJdS dS )a Checks is uid owned by reseller :param uid: uid for check :param reseller_name: Reseller name, None treats as root :return: True - valid reseller/user pair, False - else Special case: if reseller_name is None (root) - always valid )N�rootT)r� zN/AF)r r )r5 r7 ZusernameZreseller_users_listr- r- r. �_check_reseller_user_pair� s r� c C s( |dkr*| � dd �}| d }t||�s*dS td� |rh|| d krhtj�|�r\t|dd� q�t|d� n2|dkr�t�� r�ttj�| d �d� n t|d� y t � W n Y nX y4t | d }t |�}|r�|d nd}t ||d � W n t aY nX | d dk�r�d}d d � }d | k�r,t| d||d � d| k�rDt| d �} nt d } d} d| k�r|t| d | d�} | td k�r|d} |�r�t} nt} �x�| D �]�} || | ��r�x�tD ]�}|| k�r�y4|dk�r�t| dd| | � nt| |d| | � W n� tttfk �r� |dk�r| }nt| | | k}|�s6| d �r�|dk�r`t�d�}|�dt | | �� n t�|�}|�dt | | �� | � |� Y nX �q�W | � dd��s�t t� d}|�r�|| d k�r�tj�|��r�t|dd� n t|d� n6|dk�rt�� �rttj�| d �d� n t|d� t | d |d� n �q�W |�s$| d �r$|�rRt nd}t�|�} |�r�| �dt |�� | �d| d � | � t!� n:| � d��r�| �dt"�#| d �j$� n| �dt | d �� x�tD ]�}|| k�r�|dk�r�| }nt| | | k}|�s| d �r�|dk�r:t�d�}|�dt | | �� n t�|�}|�dt | | �� | � |� �q�W d}x"t%D ]}|j&�'| |� d}P �qrW |�s�tj(� | � | � dd��s�t t� |�rXtj�|� }t|dd� t | d |d� t)�|t)�*d�� t|d� tj+�,|�}x2tj+j-|d�D ] }tj.�/||� t ||d � �q W |�r�t0j1|d � n8t�� �rzttj�| d �d� n t|d� t | d � n�x`tD ]X}|| k�r�|dk�r�t!�2d�d �dt | | �� n t!�2|�d �dt | | �� �q�W | � dd��s t t� t|d� t | d |d� dS )Nr r7 r� FT)r� r� )r� rX )r c S s t | d�|d kS )N)r� r� )r� )r r� r- r- r. r � r zlve_set.<locals>.<lambda>z set-default)r� r� r� rO rN )r� rQ r� r� r� �savezskip-update-cfgr* r� r� z save-username)3r{ r� rG r* r, r= r r+ r; rD rC r~ r r� r rA r� r� r� r� r� r� r r� r~ r� r� r� r@ r� r rO r! r� r� r r r� r� Z insertBefore� lastChildrt Zlve_infor� r� Zlvp_lve_id_listr) r� r r� r� )r� r� r7 r� r� r r Zhas_veZis_needed_userr� Zcpu_is_differentZ setted_cpuZel_listr r Z is_differentr� Zel_nameZaddedZel2Zenables_reseller_limitsr� r- r- r. �lve_set� s $ r� c C sv t d� t� t| d �}t|�dkr,d}nt|�dkr@|d }|dk rftdkrf|| d< t| dd� n t| dd� dS ) zX Set package with some heuristic algorithm to simulate old package set behavior Tr� r Nr; r7 )� is_resellerF)rG r r~ r� r� �package_set_ext)r� r� Z reseller_listr r- r- r. � package_set s r� c C s� t d� t� d}|r dd� }ndd� }d| kr>t| d|d� �xtD �]}||| �rFx�tD ]�}|| kr\yJ|dkr�|�d �d �d t| | �� n |�|�d �d t| | �� W q\ tt t fk �r |dkr�t � d �}|�d t| | �� n t � |�}|�d t| | �� |� |� Y q\X q\W t�� �rTt| �d d�| d �}|�tt|�� d}qFW |�s>d}t � d�}|�d| d � |�r�|�d| d � | d }t�� �r�t|| d �}|�tt|�� xjtD ]b}|| k�r�|dk�rt � d �}|�d t| | �� n t � |�}|�d t| | �� |� |� �q�W t j� |� tt � t� t| � d| k�rlt| d �} ntd } d| k�r�t| d | d�| d< |�r�| d nd } t| d | d� d S )NTFc S s$ | � d�|d ko"| � d�|d kS )Nr� r� r r7 )r� )r r� r- r- r. r � s z!package_set_ext.<locals>.<lambda>c S s | � d�|d ko | � d� S )Nr� r� r )r� )r r� r- r- r. r � s z set-default)r� r� rQ r� r r� r� r7 rX r� r� r� r rO rN )r� )r )rG r rA r� r� r� r� r@ r r� r~ r� r� r� r< Zis_plesk�_plesk_get_package_idr{ � XML_PLESK_IDr� r � copy_package_settings_to_cpanelr� r� r� � plan_apply) r� r� Z has_packager r r r� r' Zpackage_resellerr� r r- r- r. r� � sp " r� )r r� �returnc sH t � }|�� }y tt� �fdd�|��}|d S tk rB dS X dS )z7 Find the right package id from plesk DB query c s | d �dhko| d � kS )Nr r� r; r- )r� )r� r r- r. r � r z'_plesk_get_package_id.<locals>.<lambda>r� N)r$ Z list_domain_packages_with_idrJ rK � StopIteration)r r� Zpanelrs Zpackr- )r� r r. r� � s r� c C s t �� } td� t }| a |S )z� Retrives resellers to packages map from panel using /usr/bin/getcontrolpaneluserspackages :return: Dictionary: { 'reseller1' -> ['pack1', 'pack2'], 'reseller2' -> ['pack'] } zlist-resellers-packages)rC r rD )Zpackages_users_copy�reseller_packages_mapr- r- r. r � s r c C sB | d }| d }t � }||kr:||| kr:t| dd� dS dS dS )z� Set reseller package limits :param set_data: input data dictionary :return: True - limits was set succesfully False - supplied provider has no supplied package r7 r� T)r� FN)r r� )r� r7 � package_namer� r- r- r. �reseller_package_set� s r� c C s\ | d }t �� sdS d|� �}tj�|�s.dS t|��� }|dd� }i }xx|D ]p}|�d�r�|�� � d�}|d � dd��� }|d d kr�|d ||< |t kr�|� |� |�d �rPd |krPdS qPW x2d D ]*}||kr�t �|| �} | p�t| ||< q�W t|| ��rdS t|t�} x2t D ]*}| | } d|� d| � d �} |�| � �qW td�|�|d� dS )zA Copy package limits from ve.cfg to cpanel packages data r� Nz/var/cpanel/packages/Zlve_�=r rX r; �DEFAULTZ_PACKAGE_EXTENSIONSr* )rS rR ri r� i� )r< r= ry r" r' r� r+ rY r� r� r� r� r� rr Zmemory_to_pager� �is_limits_equals�create_cpanel_limitsr� r) r% rR ) r� r� Z package_pathZcpanel_package_dataZnew_cpanel_package_dataZold_cpanel_datar� Z line_partsZ limit_nameZmemory_page_valueZ cpanel_dataZ limit_valueZ limit_liner- r- r. r� s> r� c C sV xP|� � D ]D}|dks |dkr q y| | || kr6dS W q tk rL dS X q W dS )zC check if new set of limits for package are equals to used r� r� FT)rr rF )Z old_limitsZ new_limitsr r- r- r. r� A s r� c C s� i }x�|D ]�}|� d�| kr x�tD ]�}y�|dkrRt|�d�d � d���� ||< nT|dkr�tt�t|�|�d � d������ ||< n t|�|�d � d���� ||< W q" tt t fk r� d||< Y q"X q"W q W |S ) z� create limits for cpanel package file use data from ve.cfg: limit = limit if found in ve.cfg or DEFAULT return dict r� rQ r� r r� )rR ri rS r� r� ) r� r� r@ r� r� rr Zpage_to_memoryr� r r� r~ )Z package_idZ xml_packagesZ result_datar r� r- r- r. r� P s &$r� c s� t d� t� d}�d kr(� fdd�}n� �fdd�}x.tD ]&}||�r<d}|j�|� tt� P q<W |s؈d kr�t� �}t|�dkr�d }n|d }|d k r�t � |� d S t r�t ddd � g� t � d � n td � � t� d S ) NTFc s | � d�� ko| � d� S )Nr� r )r� )r )r r- r. r r r z plan_delete.<locals>.<lambda>c s | � d�� ko| � d��kS )Nr� r )r� )r )r r7 r- r. r t r r r& r� z"no configuration found for plan %sr z+warning: no configuration found for plan %s)rG r r� r� r� r r� r~ r� r� r> r? rB rC rA r� )r r7 r� �is_needed_packager Zresellers_listr r- )r r7 r. r� m s8 r� c C s t | |d� d S )N)r7 )r� )r r7 r- r- r. �reseller_plan_delete� s r� c C sT yt | �|�d �d��S ttfk rN |dkr<t| S d�t| d �S X d S )Nr r� rN z{}%rV )r@ r� r� r r� r� r )r r r- r- r. � get_xml_limit� s r� c C sH dd� }| dkrdS t �d| i�}||dd�}|�d�}||d |� S )z� Normalize string for JSON output. Example: - Input string: -_&[{}]'"`te\s/t - Output string: -_&[{}]'"`te\\s/t\a :param data_str: String for normalize :return: Normalied string c S s: d}x0t | �D ]$\}}||kr|d7 }||kr|S qW dS )z� Get the index of the specified occurrence of character in string :param input_string: String :param char_to_search: Character to search :param ordinal: Required occurence number :return: Char index r r; r )� enumerate)Z input_stringZchar_to_searchZordinal�count�idxZchr- r- r. �_get_char_index� s z'_normalize_str.<locals>._get_char_indexNr@ r� � r; )r| r� �rfind)Zdata_strr� Zjson_strZtrd_idxZlast_idxr- r- r. rk � s rk c s. �dk r �n �rt nt�d� ��fdd� }|S )a� Generate inner function with closured fields names, is_reseller flag and printer function :param list fields: List of strings that represent names of fields in final output :param boolean is_reseller: Format output with info about reseller or not :param callable printer: Function to format and print data for every entry :rtype: callable :return: function to format data for every user Nc s� �r.t �� t�t�� �� d< ��fdd�}n�fdd�}t�t�� trPt��n�� d< dd� }|� d �� d< td kr�|� d �� d < x�tD ]�}||�r�t|d �}|d kr�|n ttd �� d < tt t|d �t � d �d�d �� d< y$tt |� d�d � d���� d< W n t tfk �r$ Y nX |t|d ��� d < |t|d��� d< t|d�� d< t|d�� d< t|d�� d< q�W � �d�dk�r�� d d � d< tt� d ��� d < g }t�r�d�� fdd��D ��}d | g}n�� fd d ��D �� |S ) a :param string package_name: Find and format data for this package name :param string reseller_name: reseller name, owner of supplied package :rtype: list :return: List of giver package's statistics data line or empty list r c s � | � d�ko| � d��kS )Nr� r )r� )r )r� r7 r- r. r � s z5_package_formatter.<locals>.wrapper.<locals>.<lambda>c s � | � d�ko| � d� S )Nr� r )r� )r )r� r- r. r � s r� c S s t r t| �S t| �S )N)r[ r[ r] )r r- r- r. r � s rR ri rW rS rO rX rN )r� rV r� r� r r� rQ rP rT rU Nr` c 3 s& | ] }d |� � |�� d�f V qdS )z "%s":"%s"zN/AN)r{ rj )r3 r� )r� r- r. r6 s z6_package_formatter.<locals>.wrapper.<locals>.<genexpr>z{%s}c s g | ]}� � |�� d ��qS )rX )r{ rj )r3 r� )r� r- r. r� s z7_package_formatter.<locals>.wrapper.<locals>.<listcomp>)r r r� r> rk rm r� r� r@ r� r� r� r� r� r r{ r� rR )r� r7 r� rf r r� rg r� )rp r� rb )r� r� r7 r. rl � sJ " z#_package_formatter.<locals>.wrapper)N)rW rV )rp r� rb rl r- )rp r� rb r. �_package_formatter� s ;r� c C s� t � td� t�� } td� t�� }tttd�}tt� dtd�}x| D ]}|||�7 }qHW t dkrttt� dtd�}xXt |�D ]L\}}t � � r�|dkr�q~x0|D ](}t dkr�||||�7 }q�|||�7 }q�W q~W t r�td d �|� d � d S ) Nz list-packageszlist-resellers-packages)rc F)r� rb r; TZadminz {"data":[r` z]})r rD rC r rh rV �DEFAULT_PACKAGEr� rq r� r r< r r> rA rR )rs �reseller_packagesrJ rn r� r7 � packages_list�reseller_packager- r- r. �get_packages_list s( r� c C s� t � td� dg} t� | }tttd�}t|dd�}x0tt�D ]$\}}x|D ]}||||�7 }qNW q@W t r�t dd� |� d � d S ) Nzlist-resellers-packagesru )rc T)r� z {"data":[r` z]}) r rD rq rh rV r� r� r rC r> rA rR )rd rp rJ rn r7 r� r� r- r- r. �get_resellers_packages_list/ s r� c C s� t � td� t�� } td� t�� }dg}t� | }ttt|d�}t|dtd�}x| D ]}|||�7 }qXW t|dd�}x0t |�D ]$\}}x|D ]} ||| |�7 }q�W q�W t r�t d d � |� d � d S ) Nz list-packageszlist-resellers-packagesru )rc rd F)r� rb T)r� z {"data": [r` z]}) r rD rC r rq rh rW r� r� r r> rA rR ) rs r� rd rp rJ rn r� r7 r� r� r- r- r. �get_all_packages_listB s" r� c C s t � }x| D ] }|||< q W |S )z� Converts package list to internal format :param package_list: Package list. Example: ['BusinessPackage', 'Package2'] :return: Package list as dictionary. Example: {'BusinessPackage': 'BusinessPackage', 'Package2': 'Package2'} )rE )� package_listZpackages_users_dictr� r- r- r. �_convert_packages_listc s r� �list-allc C s | dkr dS | dkr |dkr dS ddl m}m}m}m}m}m}m} �y�| dkr�tdk r�y"|t| d t| d d �ia W q� t k r� |ddd �ia Y q�X n@y||�\} } W n t k r� d } } Y nX || | d �ia d S n�| d kr�||||�ia d S | d k�r,t dk�r$|� } t | �a t a nt a d S | dk�rTtdk�rL|� a t anta d S | dk�rvtdk�rn|� ata d S | dk�r�tdk�r�||�} | a| a nta d S | dk�r�tdk�r�| � ata d S W n@ tk �r� } z t|� W dd}~X Y n tk �r Y nX dS )a� Parse output from GET_CP_PACKAGE_SCRIPT and get package and lve relations :param option: option for GET_CP_PACKAGE_SCRIPT. Option is one from the following possible values: 'userid', 'package', 'list-packages', 'list-resellers-packages' :type option: string :param lve_package_id: lve_id or package_name :type lve_package_id: string or int :param reseller: :type reseller: string )zlist-allrI r� z list-packageszlist-resellers-packagesz list-userszlist-reseller-usersF)rI r� rX r )� list_users�admin_packages�reseller_package_by_uid�get_uids_list_by_package�resellers_packages�get_reseller_users�list_allrI Nr� r )r� r Tz list-packageszlist-resellers-packagesz list-userszlist-reseller-userszlist-all)�clcommon.cpapir� r� r� r� r� r� r� � cached_usersrC rF r �cached_list_packagesr� �cached_resellers_packages�cached_reseller_users�cached_defaultr rD r! )ZoptionZlve_package_idr r� r� r� r� r� r� r� r7 r� r� Zreseller_users_dictr9 r- r- r. rD p st $ rD c C s t � tt�S )z2 Retrieves panel users count :return: )rD r� rC r- r- r- r. �get_panel_users_count� s r� c C s> t d� t d| |d�r:x"t| D ]}tt|�| |d� q W d S )Nz list-usersr� )r )rD rC rO r� )r r r5 r- r- r. r� � s r� c C sf x`| D ]X}|� dd�}|�� �� }x:|D ]2}t|�dkr(yt|�}t|� W q( Y q(X q(W qW d S )Nr� rX r )r� r� r� r� r� r� )� users_listr� r� r� r- r- r. � destroy_many� s r� c C s� t � y t� W n Y nX x`| D ]X}|�dd�}|�� �� }x:|D ]2}t|�dkrFyt|�}t|� W qF Y qFX qFW q$W d S )Nr� rX r )r rD r� r� r� r� r� rO )r� r� r� r� r- r- r. � apply_many s r� c C s6 t jt| �t|�|dt|� d t| � d d� d S )Nz Can`t put proccess with pid z in lve z; error code {code})r )rt Zlve_enter_pid_flagsr� r@ )ZLVEid�PID�flagsr- r- r. � limit_pid s r� c C s t jt| �dt| � d� d S )Nz Can`t release process with pid )r )rt Z lve_leave_pidr� r@ )r� r- r- r. � release_pid s r� c C s t tttttttd�S )N)r� r� r� r� r� r� r� r� )r� r� r� r� r� r� r� r� r- r- r- r. � get_globals" s r� c C s` g }t �� }td� t �� }|�� a x6t|�D ]*\}}x |D ]}| |kr<|�|g� q<W q.W |S )Nzlist-resellers-packages)rC r rD r �extend)r� r Z pkg_users_oldr� r7 r� Zpackage_name_in_keyr- r- r. r~ 4 s r~ c C s| t jt jddd�}|rxtj�|�rxt|| �\}}|dkrxd�|�}trVt dd|g� n"d| }t j � d | � t � |� d S ) z� Call Endurance's custom script :param args: list of arguments for pass to Endurance's custom script :return: None ZENDURANCE_CUSTOM_SCRIPTr� )ZfileNameZ paramNameZ separatorr z2Error while executing Endurance's custom script {}r& r: z error: %sz%s N)r< Zget_param_from_fileZCL_CONFIG_FILEry r" r' r r r> r? rB r� rF rC )�argsZendurance_custom_scriptZret_codeZstd_outrK Z err_messager- r- r. � call_endurance_custom_scriptE s r� c C s t rtt| tj ��S t| �S )a Convert page value to human-readable value or bytes, depending on BYTES_FLAG; E.g. >>> _page_to_memory_or_bytes(1233254) # BYTES_FLAG=False '100M' >>> _page_to_memory_or_bytes(1233254) # BYTES_FLAG=True 654321 :type value: int :rtype: str | int )r[ r� r� �mmapr r] )r r- r- r. �_page_to_memory_or_bytes^ s r� c C s� t � } t tj�� �}t� xVt� D ]L}y"tj�|�}||krF| �|� W q" tt t fk rl | �|� Y q"X q"W x| D ] }t |� qxW dS )zV Remove from LVE all resellers, which are absent from panel :return: None N) r5 r* r� r r r/ r� r) rF r! r� r� )Zreseller_id_list_for_deleteZcpapi_resellers_listZlve_reseller_idZlve_reseller_nameZreseller_id_for_deleter- r- r. �remove_absent_resellerso s r� c C s� x�t tj�� �D ]�\} }yt�| � W q tk r� yt�| � W nD tk r� ytj � | � t�| � W n tk r� Y nX Y nX Y qX qW dS )zM Remove from LVE all users, which absent in system :return: None N) r r* r, r� r� r rF r� r" r) r3 )r� r� r- r- r. �remove_absent_users� s r� )F)N)r )r )r r r r r r r )N)NN)r FT)T)NNN)F)F)r )NFNNr )r^ r� N)NN)r )r )r )F)F)N)FN)r� rX N)N)�Z __future__r r r �builtinsr Z past.builtinsr r Z future.utilsr r �typingr r r r r � contextlibr� r r> rH ry r� r� r� rB r Zxml.dom.minidomZdomZminidomr� r| � functoolsr r* r� r r rr Zclcommon.constr r� r r r r Z clcommon.cpapi.cpapiexceptionsr r< Zcleventsr r Z cllimits.libr Zclveconfig.ve_configr r r Zclveconfig.ve_lockr r r r r! r" r# Z clcontrollibr$ Zsecureior% ZGET_CP_PACKAGE_SCRIPTr� r� r� rl r r( rI r< r� rz r{ ZIS_DEBUGr� ZLVErt r* r/ r2 r8 rD rG rE r� r� r� r� rm r> r[ rw r rC r� r� r� r� r� r� r� r� r� r� r� rZ r\ rq rx r� r� r� r� r� r� r� r� r� �contextmanagerr� r� r� r? r� r� r� r� r� r� r9 r� r� r� r@ r� r� r r r r r$ r. r1 r3 r4 r7 r8 r� r� rH rO rQ rS rU rV rW r[ r] rh rm ro rp rt rv rz r� r� r� r� r� r� r� r� r� r� r� r� rA r� r� r� r� r� r r� r� r� r� r� r� r� rk r� r� r� r� r� r� r� r� r� r� rD r� r� r� r� r� r� r� r~ r� r� r� r� r- r- r- r. �<module> s� &%. D $ # %& Y P 2/ .# > H- &' L p