Cognitive Engine Technology

Wang Lifeng，Wei shengqun

（Institute of Chinese Electronic Equipment System Engineering Corporation, Beijing 100141, P. R. China）

Abstract:Cognitive Radio（CR）is an intelligent radio communication system,whose intelligence mostly comes from the Cognitive Engine（CE）.Based on the techniques of software-defined radio and with the support of machine reasoning and learning in artificial intelligence,cognitive engine implements the cognitive loop to realize the abilities of sensing,adaptation and learning in CR.Cognitive engine consists of the modeling system,knowledge base,reasoning engine,learning engine and interfaces.The key techniques are knowledge representation,machine reasoning and machine learning.

C ognitive Radio（CR）,an intelligent radio communication system,is able to sense the surrounding electromagnetic environment,wireless channel features and user requirements,and then as a result of reasoning and learning from past experiences,it adjusts its internal configuration and optimizes system performance to adapt to the changes of environment and requirements［1］.

As the abovementioned concept implies,besides the capabilities of sensing and adapting to environment,CRfeatures the learning capability,which is very important to intelligent activities and is what differentiates CR from other traditional radio,sensing radio and adaptive radio.Learning is a basic cognitive activity,a process of experience and knowledge accumulation,in which CRcould understand the external environments increasingly.With learning,CRis able to improve the performance of radio communication system.

Software radio technology lays the foundation for CRimplementation.The software reconfigurability of radio modules makes the adaptive adjustment of CRpossible.Meanwhile,the intelligent learning capability of CRdepends on the artificial intelligence technology.All these make it understandable that Joseph Mitola noted that CR,in principle,is the combination of software radio technology and artificial intelligence technology,when he firstly proposed the concept of CRin 1999［1］.

Cognitive Engine（CE）,which realizes intelligent reasoning and learning on the software radio platform and implements the whole cognitive loop,is the key component of CR.CEcan be deemed as the＂brain＂of CR,therefore,cognitive engine technology is the core technology for CRimplementation［2-4］.

1 Current Implementations of CE

Most CR-related studies stay theoretical at present.Few implementations of cognitive engine have been reported and they are mainly on the cognition and optimization at physical and link layers only.Among current cognitive engine implementations,the typical ones are developed by the Center for Wireless Telecommunications（CWT）of Virginia Polytechnic lnstitute and State University（VT）,and the Laboratory for Telecommunications Sciences（LTS）of USDepartment of Defense（DoD）.

1.1 VT-CWT CE

Researchers of VT-CWTpropose a general CRarchitecture［5］as shown in Figure 1.The cognitive engine is designed as an individual module to optimize and control the communication system through its cognitions to the information from the user domain,wireless domain and policy domain.

ln this general architecture,CRhas three input domains.The user domain is responsible for the input of performance requirements for applications and services to CE,such as the QoS requirements of delay and rate.The wireless domain refers to the external propagation environment and Radio Frequency（RF）channel conditions related to radio station transmission and reception.The wireless domain is important for decision optimization and waveform selection.The policy domain is responsible for the input of spectrum allocation policy and entrance permission policy for the location of CR.

The policies are explained and managed by policy engine.

According to CWTresearchers,CR,to adapt to specific spectrum environments,needs to make adjustments on waveform parameters including frequency,power,modulation modes,constellation sizes,encoding modes and encoding rates.Therefore,CR's adapting to the radio environment is a process of multi-objective optimization.The Genetic Algorithm（GA）is an effective algorithm for fulfilling multi-objective optimization.Based on this general CRarchitecture,CWT designs the GA-based cognitive engine［4-5］,as shown in Figure 2.

▲Figure 1. General cognitive radio architecture of VT-CWT.

ln this design,the Wireless Channel Genetic Algorithm（WCGA）module models the wireless channel and environment with GA;the Wireless System Genetic Algorithm（WSGA）module generates new waveform with GA;the cognitive system monitoring module consists of a knowledge base.

The long-term knowledge in the knowledge base refers to various channels processed by CEand related WSGA initialization parameters,while the short-term knowledge in it includes the cases extracted from the long-term knowledge base that are suitable for current channel.To avoid repeated GA-based optimizations under the same channel condition,a Case-Based Decision（CBD）［6］maker is implemented.

That is,if a case already exists in the knowledge base,the past optimization result will be applied directly,otherwise a new optimization process willbe performed.The cognitive system monitoring module uses the long-term knowledge to match channels in an integrated way or operate the short-term knowledge in view of application requirements.

CEcan adjust waveform-related parameters to meet the requirements of Bit Error Rate（BER）,signal bandwidth,spectrum efficiency,power,data rate and interference avoidance.So far the cognitive engine shown in Figure 2 has passed the Matrix Laboratory（Matlab）simulation and the test conducted on CR test platforms of VT.

1.2 DoD-LTS CE

When working with LTS,Charles Clancy and Erich Stuntebeck developed the Open Source Cognitive Radio（OSCR）［7］on the basis of Software Communication Architecture（SCA）and designed a CE［8］to maximize channel capacity through adjustments of modulation and encoding modes in various channel conditions.

Charles and his workmates believe that CRis the combination of a software radio and a CE,and a suite of Application Program lnterface（APl）has to be defined between the software radio and the CE.CEincludes a knowledge base,reasoning engine and learning engine,as shown in Figure 3,and its purpose is to reconfigure the software radio to fulfill some objectives.

ln CE,the knowledge base stores the current status of the external environment（signal-to-noise ratio,SNR,and BER）and software radio（modulation mode and encoding rate）,and at the same time it stores some rules that comprise conditions and operations determining what waveform needs to be selected under what status in order to maximize channel capacity.OSCRaims at a single rather than multiple objectives and has few adjustable waveform parameters,hence,only reasoning on the basis of preset rules（not GA）is required.

The cognitive engine of OSCRmakes decisions based on the long-term knowledge in the knowledge base.The reasoning engine works similarly to an expert system that uses the knowledge base to make intelligent decisions.The leaning engine,however,obtains knowledge from experiences and updates the knowledge base.The knowledge stored by the learning engine will in turn be used by the reasoning engine for subsequent work.

▲Figure 2. GA-based cognitive engine designed by VT-CWT.

?Figure 3.Cognitive enginedesigned by DoD-LTS.

The learning function of the OSCR cognitive engine is realized through trial-and-error search.According to Reference［8］,the capacity of the Additive White Gaussian Noise（AWGN）channelcan be figured out with the Shannon formula,and the waveform's BERcan also be figured out theoretically.Therefore,the optimal waveform can be obtained from reasoning.However,as for non-AWGN channel,neither the channel's capacity nor the actual performance of various waveforms are obtainable;hence proper waveforms can be concluded only from＂learning＂rather than reasoning.

Specifically,the channel capacity is a convex function of waveform's constellation size,encoding rate and BER.With the increase of constellation size and encoding rate,the BERwill increase accordingly,and the channel capacity will not necessarily grow.The lower the encoding rate and constellation size are,the more reduced BERwill be,and this will possibly lead to greater channel capacity.BERcan be obtained from the feedback of receiver,and then the actual channel capacity of the waveform can be calculated.Through continuous adjustment of waveform parameters and communication performance analysis,the cognitive engine is able to find the waveform with maximal channel capacity.

2 CE Functional Model

2.1 Cognitive Loop

The functional elements for cognition in CRinclude environment sensing,reasoning,learning and status control as well,forming a process in the mode of excitation-experience-response.CR executes the loop from Observe to Act continuously,and the cognitive information circulates to form a complete cognitive loop.

To realize the functions of an ideal CE,Mitola defines a cognitive loop that contains the stages of Observe,Orient,Plan,Decide,Act and Learn.These stages can be thought as the response sequence［8］of CEto realize its functions.The cognitive process in CRcan be taken as the transfer process of a finite state machine.

As shown in Figure 4,the loop is started with the Observe stage（observe external environment）and ended with the Act stage,passing through the following two processes［5］:

●The sensing and adaptation loop that is made of Observe,Orient,Plan,Decide and Act;

●The second loop that is called learning loop is the process of finding,forming,using and accumulating knowledge.

The cognitive loop defines the behaviors and the corresponding functions of CEonly,no specific realizations are involved.CEis responsible for realization of different cognitive loops under different conditions.This explains why the abovementioned cognitive engines feature different realization modes to suit different applications.However,they contain the same basic cognitive elements,i.e.reasoning and learning,through which to drive the circulation and repetition of the whole cognitive loop.

2.2 Functional Model

ln view of the CRdefinition,cognitive loop and functions of CE,the functional model of CEmainly includes the following elements:

（1）Modeling System

lt is the input part of CE,modeling the information of user domain,wireless（network included）domain and policy domain.That is,it identifies,integrates and abstracts the input information and prior knowledge to form machine-understandable models.lt has the objective modeling,policy modeling,service modeling,network status modeling and wireless environment modeling components.The system involves the Observe stage of the cognitive loop,and performs sensing functions.

（2）Knowledge Base

▲Figure 4. Cognitive loop.

As the core of CE,the knowledge base stores both the long-term knowledge from experiences and temporary status/environment knowledge,and it is the basis for reasoning and learning.All knowledge stored in the base in machine-understandable form.

（3）Reasoning Engine

As the＂logical thinking＂part of CE,the reasoning engine performs Orient,Plan,Decide and Act based on the knowledge in the knowledge base thus realizing the adaptation loop.The adaptation capability requires the reasoning and decision making techniques from artificial intelligence.

（4）Learning Engine

As the＂creative thinking＂part of the cognitive engine,the learning engine can find,form and accumulate knowledge through the feedback of action result,and store the new knowledge to the knowledge base.The machine learning techniques of artificial intelligence is required to realize the learning capability.

Other necessary elements include various interfaces and resource monitoring modules.They can be implemented on the software radio platform.

Spectrum management is an important application for CR.Here the policy engine is integrated into the cognitive engine.The spectrum policy inputting and sensing is implemented in the modeling system and the dynamic spectrum policy management and application is decomposed into reasoning and leaning modules.

3 Key Technologies of Cognitive Engine

The cognitive engine in CRis a functional component separable from the communication system.ln fact,the communication system addresses the problem of uncertainty,with the purpose of transmitting or restoring precisely the information carried with the waveforms,and reducing the uncertainty caused by noises and interferences.The cognitive engine,however,addresses the problem of complexity,with the purpose of learning user's requirement and environment status in light of the data from the sensor,and optimizing the communication system to meet the demands and adapt to the environment.

Since artificial intelligence is the strategy and method for addressing the complex problems,the cognitive engine mainly involves the artificial intelligence technologies.

The key technologies for CEimplementation include knowledge representation,machine reasoning and machine learning.

3.1 Knowledge Representation Technology

Knowledge representation refers to describing the knowledge and expressing the knowledge in a data structure that can be treated by computers［9］.According to human's various exploration perspectives and different understanding of problems,the knowledge representation methods can be either declarative or behavioral.The declarative knowledge representation is used to describe factualknowledge,for example,the SNRof a channel,and current working parameters of a radio.The behavioral knowledge representation is used to describe rule-related knowledge and control knowledge,for example,the waveform parameter configuration rule of CRin a specific environment.

ln CE,the knowledge representation technology is used to construct the knowledge base.The CRknowledge base consists of short-term and long-term knowledge.The short-term knowledge means the current status,including external environment status and internal working parameters,while the long-term knowledge includes the bases of rules and cases.The rule base stores the general knowledge related with radio and radio communication,for example,deduction of parameters such as a waveform's information rate and bandwidth,and estimation of BER.This type of knowledge is used for the reasoning process.The case base stores the experience of CR.On one hand,the case base stores the sensed data of external environment,including the status of localelectromagnetic environment and the transmission characteristics of channels.These data are the object for learning and the basis to implement learning.By processing these data,CEis able to obtain helpful experience and knowledge,such as how the local spectrums are used and which channelis usually available.On the other hand,the case base stores the operations used in each communication process and their results as well.Similar to engineers solve problems by drawing on past experiences,or avoid mistakes by learning from past failures.The case base helps CEcome up with optimized decisions rapidly.

At present,most description languages,such as Specification and Description Language（SDL）,Unified Modeling Language（UML）,lnterface Definition Language（lDL）,and Extensible Markup Language（XML）,lack of accuracy and flexibility.Radio Knowledge Representation Language（RKRL）,developed by the Royal Swedish Academy of Sciences,and the ontology-based knowledge representation techniques have been studied in depth.

3.2 Machine Reasoning Technology

Reasoning refers to the process of using the mastered knowledge to deduce implied factual conclusion or induce some new conclusions according to current facts［9］.The reasoning engine,based on the contents of short-term knowledge base,performs matching and selection on the contents in the rule base and case base.The produced interim results then stores back into the short-term knowledge base.The reasoning engine repeats the matching and selection operation on the rule base and case base again and again until a final result is obtained.

As the long-term knowledge,short-term knowledge and reasoning engine are the foundation of the modern rule-based expert system［10］,CEis firstly an expert system in the field of radio communication.The reasoning engine uses the knowledge base to perform rule-or case-based reasoning.Currently,the reasoning function is provided in many general environments for developing artificial intelligence or in the expert system shells,such as C Language lntegrated Production System（CLlPS）［10］and SOAR［11］.The developers only need to develop the professional knowledge base according with the grammatical definitions to construct an expert system in a specific field.The cognitive engines in Reference［7］and Reference［8］are developed on the basis of SOAR.

At present,available machine reasoning algorithms are:state space model and search,rule-based system,case-based reasoning,neural network,fuzzy logic,GAand knowledge-based reasoning.

3.3 Machine Learning Technology

Machine learning is a discipline that studies how to use the computer to simulate the learning activities of humankind.Strictly speaking,it researches the methods with which the computer obtains new knowledge and techniques,identifies current knowledge,to gradually improves the performance and itself［9］.Herbert Simon defines learning as:Any change that makes the system carry out the same task,or another task of the same quantity,in a better way than it does in the previous time.lt is the capability of learning from experiences that differentiates CRfrom other radio;and it is the most important feature of CR.

To learn different knowledge,CE needs to integrate multiple learning algorithms.Three major algorithms are as follows:

（1）Supervised learning,used for learning the external environment,that is,to use the measured data to train the estimator.For example,in the situation of sensing channel,CRdoes not know the specific channel parameters until the communication begins.Hence,CRhas to select some parameters based on prediction.Once the communication ends,related channel parameters can be obtained through estimation.CEcan use the estimated parameters to train the channel predication model so as to better match the current channel.

（2）Non-supervised learning,used for learning the external environment,that is,to extract the change characteristics of related environment parameters.For example,in situation of finding the busy/idle state of spectrums,it is required to obtain the temporaland frequency distribution of spectrum holes according to the case base.

（3）Reinforcement learning,used for learning internal rules or behaviors.lt is to use encouragement and punishment to highlight the rules or behaviors that best suit current environment and discard those that do not suit current environment.For example,reinforcement learning can be used to select one waveform that suit current channel conditions from several waveforms.

At present,available machine learning algorithms are:Bayesian logic,decision tree,Q-learning,time difference method,neural network,game theory and GA.

4 Conclusion

Cognitive engine is the source of intelligence in CR.Realized on the software radio platform and equipped with artificial intelligence,CE,with good interface definition,can support more the possible CRapplications,including dynamic spectrum sharing,dynamic waveform reconfiguration,cooperative and relay communication,cognitive network,and heterogeneous network convergence.With the development of cognitive engine technologies,CRis promised to apply in much wider area in the future.