Rosman, Benjamin S2014-12-222014-12-222014-10Rosman, B.S. Feature Selection for Domain Knowledge Representation through Multitask Learning. IEEE International Conference on Development and Learning and on Epigenetic Robotics (ICDL-EpiRob), Genoa, Italy, 13-16 October 2014.http://www.benjaminrosman.com/papers/icdl14.pdfhttp://hdl.handle.net/10204/7825IEEE International Conference on Development and Learning and on Epigenetic Robotics (ICDL-EpiRob), Genoa, Italy, 13-16 October 2014. Abstract only version.Representation learning is a difficult and important problem for autonomous agents. This paper presents an approach to automatic feature selection for a long-lived learning agent, which tackles the trade-off between a sparse feature set which cannot represent stimuli of interest, and rich feature sets which increase the dimensionality of the space and thus the difficulty of the learning problem. We focus on a multitask reinforcement learning setting, where the agent is learning domain knowledge in the form of behavioural invariances as action distributions which are independent of task specifications. Examining the change in entropy that occurs in these distributions after marginalising features provides an indicator of the importance of each feature. Interleaving this with policy learning yields an algorithm for automatically selecting features during online operation. We present experimental results in a simulated mobile manipulation environment which demonstrates the benefit of our approach.enArtificial intelligenceRepresentation learningMultitask learningDomain knowledge representationConference PresentationRosman, B. S. (2014). Feature selection for domain knowledge representation through multitask learning. IEEE. http://hdl.handle.net/10204/7825Rosman, Benjamin S. "Feature selection for domain knowledge representation through multitask learning." (2014): http://hdl.handle.net/10204/7825Rosman BS, Feature selection for domain knowledge representation through multitask learning; IEEE; 2014. http://hdl.handle.net/10204/7825 .TY - Conference Presentation AU - Rosman, Benjamin S AB - Representation learning is a difficult and important problem for autonomous agents. This paper presents an approach to automatic feature selection for a long-lived learning agent, which tackles the trade-off between a sparse feature set which cannot represent stimuli of interest, and rich feature sets which increase the dimensionality of the space and thus the difficulty of the learning problem. We focus on a multitask reinforcement learning setting, where the agent is learning domain knowledge in the form of behavioural invariances as action distributions which are independent of task specifications. Examining the change in entropy that occurs in these distributions after marginalising features provides an indicator of the importance of each feature. Interleaving this with policy learning yields an algorithm for automatically selecting features during online operation. We present experimental results in a simulated mobile manipulation environment which demonstrates the benefit of our approach. DA - 2014-10 DB - ResearchSpace DP - CSIR KW - Artificial intelligence KW - Representation learning KW - Multitask learning KW - Domain knowledge representation LK - https://researchspace.csir.co.za PY - 2014 T1 - Feature selection for domain knowledge representation through multitask learning TI - Feature selection for domain knowledge representation through multitask learning UR - http://hdl.handle.net/10204/7825 ER -