94 results about "Stochastic control" patented technology

A method of controlling at least one of the launch time of the ball, the speed of rotation of the wheel, and the speed of movement of the ball, in such a way that none of those factors is under the immediate control of a game manager; and displaying information to confirm the randomness of the operation.

An Innervated Stochastic Controller optimizes business decision-making under uncertainty through time. The Innervated Stochastic Controller uses a unified reinforcement learning algorithm to treat multiple interconnected operational levels of a business process in a unified manner. The Innervated Stochastic Controller generates actions that are optimized with respect to both financial profitability and engineering efficiency at all levels of the business process. The Innervated Stochastic Controller can be configured to evaluate real options. In one embodiment of the invention, the Innervated Stochastic Controller is configured to generate actions that are martingales. In another embodiment of the invention, the Innervated Stochastic Controller is configured as a computer-based learning system for training power grid operators to respond to grid exigencies.

Processing of genomic data is facilitated by providing a control data set generation system wherein a control generator tool or process creates matched data sets for facilitating informatics analysis. These matched data sets may include genomic loci or genomic sequences, or both. The data is taken from a database of actual genomic data, including sequence and annotation data, as opposed to ad-hoc generation, sequence scrambling or the like. This produces biologically relevant and accurate results which allow for stronger controls. The controls are matched against a user-provided data set via a number of parameters.

The invention includes a system and process that employs contractual bargaining with agent-based computational methods for the dynamic allocation, optimization, and pricing of contingent rights and obligations between multiple counterparties with overlapping interests. The processes employ a dynamic and endogenous hierarchy or tiering of binding incentive compatible contingent strategies, which may include optimal liquidation policies for matched assets and liabilities based upon stochastic volume / price schedule related to statistically non-stationary supply / demand elasticities and order-flow, as well as variations in market microstructure. The invention includes a dynamic open system with distributed stochastic control of strategic interactions among dynamic optimizing agents across random states, wherein the actions of any one affects the joint costs and benefits for all the agents.

An Innervated Stochastic Controller optimizes business decision-making under uncertainty through time. The Innervated Stochastic Controller uses a unified reinforcement learning algorithm to treat multiple interconnected operational levels of a business process in a unified manner. The Innervated Stochastic Controller generates actions that are optimized with respect to both financial profitability and engineering efficiency at all levels of the business process. The Innervated Stochastic Controller can be configured to evaluate real options. In one embodiment of the invention, the Innervated Stochastic Controller is configured to generate actions that are martingales. In another embodiment of the invention, the Innervated Stochastic Controller is configured as a computer-based learning system for training power grid operators to respond to grid exigencies.

An apparatus randomly assigns downlink sub-frame time slots for transmitting user data in an NB-TDD CDMA (Code Division Multiple Access) communication system. In the apparatus, a multiplexer creates a user data part by multiplexing user data for UEs (User Equipments), a TFCI (Transport Format Combination Indicator) symbol for the user data, and a TPC (Transmission Power Control command) symbol for controlling transmission power of a downlink channel, and a controller randomly assigns time slots for transmitting the user data part in the sub-frames, based on a time slot number initially assigned for the user data part, a sub-frame number at a transmission point of the user data part, and the number of assigned uplink time slots in the corresponding sub-frame.

The invention discloses a random control strategy of cylinder deactivation of part of cylinders of a multi-cylinder engine. One or a plurality of cylinders are selected as working cylinders under the working condition of partial load; the combination of the cylinder as the working cylinder is randomly determined by a control system which carries out monitoring to the vibration condition of the engine and a chassis and randomly determines another different cylinder combination as the working cylinder before the engine and the chassis of an automobile occur resonance. As the cylinder deactivation of the cylinders is irregular in different working cycle, the fluctuation of an output torque is aperiodic and can not excite periodic forced vibration of the system, therefore, the amplitude of vibration of the system is controlled, the number of the cylinder deactivation can be increased and is not limited by the number of the cylinder, even only one cylinder works, thus expanding the application range of the technology of cylinder deactivation and having more obvious oil-saving effect. The control strategy can be realized by a software method under the condition that the cut off of air and oil of each cylinder can be independently carried out.

A method and system are disclosed for improving a policy for a stochastic control problem, the stochastic control problem being characterized by a set of actions, a set of states, a reward structure as a function of states and actions, and a plurality of decision epochs, the method comprising using a sampling device obtaining data representative of sample configurations of a Boltzmann machine, obtaining initialization data and an initial policy for the stochastic control problem; assigning data representative of an initial weight and a bias of respectively each coupler and each node and the transverse field strength of the Boltzmann machine to the sampling device; until a stopping criterion is met generating a present-epoch state-action pair, amending data representative of none or at least one coupler and at least one bias, performing a sampling corresponding to the present-epoch state-action pair to obtain first sampling empirical means, obtaining an approximation of a value of a Q-function at the present-epoch state-action, obtaining a future-epoch state-action pair, wherein the state is obtained through a stochastic state process, and further wherein the obtaining of the action comprises performing a stochastic optimization test on the plurality of all state-action pairs comprising the future-epoch state and any possible action to thereby provide the action at the future-epoch and update the policy for the future-epoch state; amending data representative of none or at least one coupler and at least one bias, performing a sampling corresponding to the future-epoch state-action pair, obtaining an approximation of a value of the Q-function at the future-epoch state-action, updating each weight and each bias and providing the policy when the stopping criterion is met.

A computer implemented method, apparatus, and computer usable program code for controlling when to send messages in a stream processing system. A policy is determined by utilizing probability statistics and a cost function prior to stream processing. The policy specifies under which conditions a message is sent eagerly and under which other conditions the message is delayed. A filter is operated during stream processing that selects which of the messages to send from a sending transform based upon a threshold. A controller is operated during stream processing that observes a current state of a receiving transform and that applies the policy based on the current state to determine whether to change the threshold.

A method and apparatus controls power consumption of at least one processor core by generating dynamic voltage and clock frequency scaling control information based on stochastic controller control parameters and workload performance error data. A processor core's voltage and clock frequency is varied based on the generated dynamic voltage and clock frequency scaling control information. In one example, a stochastic controller, is coupled to a dynamic voltage and clock frequency scaling (DVFS) circuit. The stochastic controller uses the stochastic controller control parameters and workload performance error data and generates the dynamic voltage and clock frequency scaling control information to control the DVFS circuit. Related methods are also disclosed.

Stochastic control problems of linear systems in high dimensions are solved by modeling a structured Markov Decision Process (MDP). A state space for the MDP is a polyhedron in a Euclidean space and one or more actions that are feasible in a state of the state space are linearly constrained with respect to the state. One or more approximations are built from above and from below to a value function for the state using representations that facilitate the computation of approximately optimal actions at any given state by linear programming.

This invention relates to one road intelligent control method, which operates in the road traffic control system composed of infrared receiver, emission, single machine and road traffic lamps to control traffic lamp switch time, wherein, it uses two sets of infrared receivers, emission test road real time flow; then according to test road car flow, random control traffic lamp switch time to make the traffic control for intelligent degree; two sets of infrared receiver and emission device to test infrared receiver number with one block with one car default.

The invention discloses a physical unclonable function circuit comprising n cascaded data delay circuits, n clock delay circuits and an arbitration device; control ends of the data delay circuits are used for receiving random control signals, first output ends and second output ends of the data delay circuits are respectively connected with first input ends and second input ends of the data delay circuits of a next grade, data ends of the n data delay circuits are orderly and respectively connected with input ends of n clock delay circuits, output ends of the clock delay circuits are connected with the arbitration device, and the arbitration device is used for determining output data according to signals output by the n clock delay circuits. Data delay deviation and clock delay deviation can be introduced at the same time via the circuit, mathematical modeling difficulty is increased, and therefore safety of the PUF circuit can be improved.

The invention relates to a novel distribution box characterized by no contact, extended service life, soft starting and energy saving. The invention is applicable under the bad environment such as kindle-prone, explosion-prone and dust. As an innovative and replaceable product of distribution box, the invention changes the present structure module of the mechanical distribution box without using any ac contactor, and changes the distribution structure which can only control the connection or disconnection of the source into the intelligent automatic structure according to the loading requirement. The invention has no spark, presents safety and reliability, and prolongs the service life greatly. The structure is divided into the following four parts: a series connected thyristor main circuit, a center controlling circuit, a multifunction protection circuit and an eliminating harmonic instantaneous flow purification circuit. The invention has a multifunction protection system for protecting the safety of the devices. The invention also has an advanced soft starting system which greatly reduces current and voltage and completely removes the hulking antihypertensive starting equipment totally to save investment. The invention has a quick inspection and central processing system which stochastically controls the electricity consumption quantity and increases the power factor to save electricity. Furthermore, the invention has the advantages of small volume, light weight, automatic and easy operation, steady running and few needs of maintenance .

Systems and methods are disclosed herein for syntonizing machines in a network. A coordinator accesses probe records for probes transmitted at different times between pairs of machines in the mesh network. For different pairs of machines, the coordinator estimates the drift between the pair of machines based on the transit times of probes transmitted between the pair of machines as indicated by the probe records. For different loops of at least three machines in the mesh network, the coordinator calculates a loop drift error based on a sum of the estimated drifts between pairs of machines around the loop and adjusts the estimated absolute drifts of the machines based on the loop drift errors. Here, the absolute drift is defined relative to a drift of a reference machine.

A controller for a vehicle including two inverters determines whether a detector currently performs an insulation determination process, and if not, the controller performs random control to randomly vary carrier frequencies corresponding to the two inverters, respectively. In contrast, if the insulation determination process is currently performed, the controller prohibits the random control and fixes the carrier frequencies at reference frequencies, respectively. The reference frequencies are previously set to have a difference Δfs larger than a predetermined value f1.

Random control voltages are applied to an oscillating circuit with an oscillation frequency control section from a noise generating circuit to generate random oscillation voltages which correspond to frequency signals from the oscillating circuit. The random oscillation voltages are digitally converted at an A / D converter and input into a personal computer, where a given threshold value is defined to the amplitudes of the random oscillation voltages and numerals “0” and “1” are allotted to the random oscillation voltages on the magnitude relation between the threshold value and the amplitudes of the random oscillation voltages. As a result, a binary random number relating to numerals “0” and “1” can be generated.

The invention discloses a method for optimally controlling magnetorheological damping of a random seismic excitation system. In the method, the active optimal control design is carried out by adopting a physical random optimal control strategy with the two-step optimizing character according to a control system with a random seismic excitation structure; the active optimal control grain design iscarried out by adopting a second order statistic evaluation criterion of the system to obtain an optimal control law parameter and thus the target active optimal control force for the design of a magnetorheological damping optimal control system is determined; and by adopting the target active optimal control force realized by tracking as a control criterion, the magnetorheological damping optimal control design is carried out by adopting a delimitation Hrovat semi-active random control strategy. In the invention, on the basis of a probability density evolution theory frame, the hedge of describing the classical random optimal control of a power system by using an Ito random differential equation is broken through; and the method opens up a new path for the active random optimal control.

Embodiments of the present invention provide a random number generating apparatus, including a first level sampling module and a second level sampling module. The first level sampling module includes a first oscillator, a second oscillator and a first sampler capable of sampling the first oscillating signal with the second oscillating signal to generate a first output signal. The second level sampling module includes a voltage-controlled oscillator capable of generating a voltage-controlled oscillating signal by using the first output signal as a control voltage, a third oscillator capable of generating a third oscillating signal, and a second sampler, capable of sampling the third oscillating signal with the voltage-controlled oscillating signal and generating random numbers. The first level oscillator sampling provides a random control voltage for the second level oscillator sampling, therefore improving the randomicity of the second level oscillator sampling as well as the random number generating rate.

A method and system for controlling message flow in distributed stream processing. State transition probabilities in a Markov model having one state per staleness value of data are determined for sending or withholding updates of data to subscribers using expected message rates from an information provider. A cost function annotates each state transition in the model with a state transition cost for each decision to “send” or “withhold”. A propagation policy specifying whether to send or withhold the message is determined for each state. The propagation policy is then deployed. If a new message comprising an update of data is received during a lapsed time unit, a staleness value of the data held by subscribers is increased. The propagation policy is used to determine whether to send or withhold the message. If the message should be sent, the message is propagated and the staleness value of the data is reset.

The invention discloses an oxygen automatic control system and method for a rescue capsule, and belongs to a gas automatic control system and method. Oxygen automatic control in the rescue capsule comprises the system and the method. The gas source apparatus of the system is sequentially connected with a gas pressure reduction apparatus and a gas flow velocity measuring feedback apparatus through a gas busbar, the gas outlet of the gas flow velocity measuring feedback apparatus is connected with an oxygen output solenoid valve; the signal output end of the gas flow velocity measuring feedback apparatus, together with the output end of an oxygen sensor, is connected with the input end of a master controller, the master controller is connected with a host computer, and the control output end of the master controller is connected with the oxygen output solenoid valve for randomly controlling the oxygen output solenoid valve; and the selection of the gas flow velocity measuring feedback apparatus enables a feedback loop to be formed during oxygen control. A fuzzy PID algorithm embedded in a system controller can realize adaptability to the time-varying characteristic of a system model so as to realize accurate oxygen supply. The selection of the gas flow velocity measuring feedback apparatus can realize a system oxygen dynamic time limit pre-estimation function.

The invention aims to overcome defects in the prior art, be adapted to practical requirements, improve the trailing edge flap airfoil curve quality, increase the number of control points of a trailing edge flap control surface airfoil leading edge curve and reduce the construction quality so as to improve the curve quality of the trailing edge flap airfoil leading edge. A double-circle method comprises step one, retaining two points of c1 and c2 in the leading edge curve intersecting an aircraft airfoil and a chord length control point c2; step two, selecting a random control point c7 at the highest point of the maximum thickness at the aircraft leading edge or the highest point of the maximum thickness close to the aircraft leading edge; and step three, fitting the four points smoothly successively, and using a first curvature circle and a second curvature circle for controlling curvature at the control points c2 and c7 respectively to obtain a smooth curve. According to the double-circle method, the flap leading edge curve molding scheme is simple in operation and feasible, and a flap curved surface required by aerodynamic force can be designed through computer-aided design software.

The invention relates to a catastrophe filter algorithm. A large quantity of state catastrophes exist in the natural world, and therefore signal processing becomes very important for the kind of systems. In combination with system characteristics and state information, system noise and observation noise are regarded as two stochastic control variables, a catastrophe potential function is established, a singular point set is solved, catastrophe characteristics are evaluated through a catastrophe series method, then the normalized membership degree of the state catastrophes is calculated to express the degree of the state catastrophes, if catastrophes happen on a state completely, a last state predication value is not considered in the filter calculation in this time, and state evaluation is performed in combination with a sampling point data predication value and a current measurement value. If catastrophes happen on the state partially, a using state predication value is calculated according to the membership degree of the catastrophes, and then state evaluation is performed in combination with the sampling point data predication value and the current measurement value. The catastrophe filter algorithm has the advantages that a mathematical model and statistics characteristics of the system noise and measurement noise do not need to be known accurately, and the catastrophe filter algorithm is particularly suitable for performing signal processing on strong-nonlinearity and strong-stochastic systems.

The invention discloses a transmission frame sequence control method based on a packet mechanism. The method comprises the following steps that: (1) a host machine writes configuration data into a configuration register; (2) a control state machine starts a sequence number generating unit, a computing unit and a transmission unit; and (3) the sequence number generating unit generates a random control sequence number; the transmission unit checks a transmission mode started by the host machine; and corresponding frames are transmitted normally or transmitted repeatedly or discarded or transmitted disorderly according to the transmission mode till all frames are transmitted. The sequence of bottom-layer transmission frames belonging to the same top-layer data is controlled according to the configuration of the host machine, so that random repeated transmission, discarding and disordered transmission of the frames are realized. Control of a transmission frame sequence is realized through processing of a packet transmission sequence, so that the test demand of a network is met, and the aims of easiness in implementation, flexibility in use and reduction of cost are fulfilled.

The invention discloses a modeling method of a formation stochastic control system for missile autonomous formation with multiplicative noise, and belongs to the technical field of aircraft formationnavigation, guidance and control. The modeling method takes the formation stochastic control system for missile autonomous formation as a research object, and the obtains a stochastic system model forformation control by performing analysis and modeling on the formation stochastic interference and introducing stochastic factors into a formation model. For the control problem of the formation stochastic model for missile autonomous formation, the modeling method uses an estimator to estimate the system state, and uses a stochastic robust analysis and design method (SRAD) to optimize the estimator and controller of the formation stochastic model, so that the parameters of the controller can meet the requirements of stability and performance.

The invention provides a chaotic security key distribution scheme based on post-processing. The scheme includes synchronous true random number module and post-processing module. In the present invention, both parties of the communication independently change the injection intensity of the driving signal by using an optical attenuator controlled by a random control parameter generator. Only when the injection intensities of both parties of the communication are the same, the response lasers of both parties of the communication can achieve good synchronization and produce synchronous true randomnumber. Then, the synchronized true random number is used as the seed key of the staggered stop algorithm in the post-processing module, and the generation rate of the key is improved through multiple calls. After testing, the final key can pass 15 NIST tests.