%0 %0 Conference Proceedings %A Coates, A.; Lee, H. & Ng, A.Y. %D 2011 %T An analysis of single-layer networks in unsupervised feature learning %E Gordon, Geoffrey; Dunson, David & Dudík, Miroslav %B Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics %C %I JMLR W\&CP %V 15 %6 %N %P 215--223 %& %Y %S JMLR Workshop and Conference Proceedings %7 %8 %9 %? %! %Z %@ %( %) %* %L %M %1 %2 %3 inproceedings %4 %# %$ %F coates2011analysis %K feature, learning, machine, ml, unsupervised %X A great deal of research has focused on algorithms for learning features from unlabeled data. Indeed, much progress has been made on benchmark datasets like NORB and CIFAR-10 by employing increasingly complex unsupervised learning algorithms and deep models. In this paper, however, we show that several simple factors, such as the number of hidden nodes in the model, may be more important to achieving high performance than the learning algorithm or the depth of the model. Specifically, we will apply several off-the-shelf feature learning algorithms (sparse auto-encoders, sparse RBMs, K-means clustering, and Gaussian mixtures) to CIFAR-10, NORB, and STL datasets using only single-layer networks. We then present a detailed analysis of the effect of changes in the model setup: the receptive field size, number of hidden nodes (features), the step-size ("stride") between extracted features, and the effect of whitening. Our results show that large numbers of hidden nodes and dense feature extraction are critical to achieving high performance - so critical, in fact, that when these parameters are pushed to their limits, we achieve state-of-the-art performance on both CIFAR-10 and NORB using only a single layer of features. More surprisingly, our best performance is based on K-means clustering, which is extremely fast, has no hyper-parameters to tune beyond the model structure itself, and is very easy to implement. Despite the simplicity of our system, we achieve accuracy beyond all previously published results on the CIFAR-10 and NORB datasets (79.6% and 97.2% respectively). %Z %U http://jmlr.csail.mit.edu/proceedings/papers/v15/coates11a.html %+ %^ %0 %0 Conference Proceedings %A Coates, A.; Carpenter, B.; Case, C.; Satheesh, S.; Suresh, B.; Wang, Tao; Wu, D.J. & Ng, A.Y. %D 2011 %T Text Detection and Character Recognition in Scene Images with Unsupervised Feature Learning %E %B International Conference on Document Analysis and Recognition (ICDAR) %C %I %V %6 %N %P 440--445 %& %Y %S %7 %8 September %9 %? %! %Z %@ %( %) %* %L %M %1 %2 %3 inproceedings %4 %# %$ %F coates2011detection %K feature, learning, machine, ml, ocr %X Reading text from photographs is a challenging problem that has received a significant amount of attention. Two key components of most systems are (i) text detection from images and (ii) character recognition, and many recent methods have been proposed to design better feature representations and models for both. In this paper, we apply methods recently developed in machine learning -- specifically, large-scale algorithms for learning the features automatically from unlabeled data -- and show that they allow us to construct highly effective classifiers for both detection and recognition to be used in a high accuracy end-to-end system. %Z %U http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=6065350&tag=1 %+ %^ %0 %0 Book Section %A Rubens, Neil; Kaplan, Dain & Sugiyama, Masashi %D 2011 %T Active Learning in Recommender Systems %E Ricci, Francesco; Rokach, Lior; Shapira, Bracha & Kantor, Paul B. %B Recommender Systems Handbook %C %I Springer US %V %6 %N %P 735--767 %& 23 %Y %S %7 %8 %9 %? %! %Z %@ 978-0-387-85819-7 %( %) %* %L %M %1 %2 %3 incollection %4 %# %$ %F rubens2011active %K active, learning, machine, recommender %X %Z %U http://dx.doi.org/10.1007/978-0-387-85820-3_23 %+ %^ %0 %0 Conference Proceedings %A Scholz, Christoph; Doerfel, Stephan; Atzmueller, Martin; Hotho, Andreas & Stumme, Gerd %D 2011 %T Resource-Aware On-Line RFID Localization Using Proximity Data %E %B %C %I %V %6 %N %P %& %Y %S %7 %8 %9 %? %! %Z %@ %( %) %* %L %M %1 %2 %3 inproceedings %4 %# %$ %F DBLP:conf/pkdd/ADHSS11 %K 2011, data, itegpub, learning, localization, machine, mining, myown, rfid %X %Z %U %+ %^ %0 %0 Book %A Mitchell, Tom M. %D 2010 %T Machine learning %E %B %C New York, NY [u.a. %I McGraw-Hill %V %6 %N %P %& %Y %S %7 %8 %9 %? %! %Z %@ 0071154671 9780071154673 %( %) %* %L %M %1 %2 Machine Learning: Tom M. Mitchell: 9780070428072: Amazon.com: Books %3 book %4 %# %$ %F mitchell2010machine %K Mitchell, book, info2.0, learning, machine %X %Z %U http://www.amazon.com/Machine-Learning-Tom-M-Mitchell/dp/0070428077 %+ %^ %0 %0 Journal Article %A Raykar, Vikas C.; Yu, Shipeng; Zhao, Linda H.; Valadez, Gerardo Hermosillo; Florin, Charles; Bogoni, Luca & Moy, Linda %D 2010 %T Learning From Crowds %E %B Journal of Machine Learning Research %C %I JMLR.org %V 11 %6 %N %P 1297--1322 %& %Y %S %7 %8 August %9 %? %! %Z %@ 1532-4435 %( %) %* %L %M %1 %2 %3 article %4 %# %$ %F raykar2010learning %K cirg, collective, computing, crowdsourcing, extraction, human, ie, information, intelligence, learning, machine, ml, social %X For many supervised learning tasks it may be infeasible (or very expensive) to obtain objective and reliable labels. Instead, we can collect subjective (possibly noisy) labels from multiple experts or annotators. In practice, there is a substantial amount of disagreement among the annotators, and hence it is of great practical interest to address conventional supervised learning problems in this scenario. In this paper we describe a probabilistic approach for supervised learning when we have multiple annotators providing (possibly noisy) labels but no absolute gold standard. The proposed algorithm evaluates the different experts and also gives an estimate of the actual hidden labels. Experimental results indicate that the proposed method is superior to the commonly used majority voting baseline. %Z %U http://dl.acm.org/citation.cfm?id=1756006.1859894 %+ %^ %0 %0 Conference Proceedings %A Gerland, Patrick; Schulte, Horst & Kroll, Andreas %D 2009 %T Probability-based global state detection of complex technical systems and application to mobile working machines %E %B European Control Conference (ECC) %C Budapest, Hungary %I IEEE %V %6 %N %P 1269--1274 %& %Y %S %7 %8 August 23--26 %9 %? %! %Z %@ 978-963-311-369-1 %( %) %* %L %M %1 %2 DVD-ROM %3 inproceedings %4 %# duerrbaum %$ %F Gerland2009ECC %K Automotive, Complex, Machine, learning;, systems; %X Frequently, the increasing level of automation requires a systematic consideration of numerous interacting components influenced by internal feedback mechanisms as well as interactions with human operators under varying environmental conditions. This places demands on modeling, which in general cannot be satisfied by traditional modeling concepts. In this paper, a model approach for complex technical systems is developed, which consists of two language layers. The first layer takes the physical knowledge of the technical system into account. The second one uses stochastic models in combination with superordinate higher-level terms to formulate properties concerning the overall system. By means of a case study dealing with the automation of mobile working machines, it is shown that this approach can be used to recognize driving situations under varying environmental conditions. %Z %U %+ %^ %0 %0 Conference Proceedings %A Gerland, Patrick; Schulte, Horst & Kroll, Andreas %D 2009 %T Probability-based global state detection of complex technical systems and application to mobile working machines %E %B European Control Conference (ECC) %C Budapest, Hungary %I IEEE %V %6 %N %P 1269 -- 1274 %& %Y %S %7 %8 August 23 -- 26 %9 %? %! %Z %@ 978-963-311-369-1 %( %) %* %L %M %1 %2 DVD-ROM %3 inproceedings %4 %# duerrbaum %$ %F Gerland2009ECC %K Automotive, Complex, Machine, learning;, systems; %X Frequently, the increasing level of automation requires a systematic consideration of numerous interacting components influenced by internal feedback mechanisms as well as interactions with human operators under varying environmental conditions. This places demands on modeling, which in general cannot be satisfied by traditional modeling concepts. In this paper, a model approach for complex technical systems is developed, which consists of two language layers. The first layer takes the physical knowledge of the technical system into account. The second one uses stochastic models in combination with superordinate higher-level terms to formulate properties concerning the overall system. By means of a case study dealing with the automation of mobile working machines, it is shown that this approach can be used to recognize driving situations under varying environmental conditions. %Z %U %+ %^ %0 %0 Thesis %A Illig, Jens %D 2008 %T Machine Learnability Analysis of Textclassifications in a Social Bookmarking Folksonomy %E %B %C Kassel %I University of Kassel %V %6 %N %P %& %Y %S %7 %8 %9 Bachelor Thesis %? %! %Z %@ %( %) %* %L %M %1 %2 %3 mastersthesis %4 %# %$ %F illig2008machine %K classification, learning, machine, recommendations, recommender, tags %X %Z %U %+ %^ %0 %0 Thesis %A Illig, Jens %D 2008 %T Machine Learnability Analysis of Textclassifications in a Social Bookmarking Folksonomy %E %B %C Kassel %I University of Kassel %V %6 %N %P %& %Y %S %7 %8 %9 Bachelor Thesis %? %! %Z %@ %( %) %* %L %M %1 %2 %3 mastersthesis %4 %# %$ %F illig2008machine %K Illig, bachelor, classification, learning, machine, recommendations, text %X %Z %U %+ %^ %0 %0 Book %A %D 2007 %T Introduction to Statistical Relational Learning (Adaptive Computation and Machine Learning) %E Getoor, Ben Taskar Lise %B %C %I %V %6 %N %P %& %Y %S %7 %8 %9 %? %! %Z %@ %( %) %* %L %M %1 %2 %3 book %4 %# %$ %F srl2007 %K 2007, KI2007WebMining, learning, machine, stat, statistical %X %Z %U %+ %^ %0 %0 Journal Article %A Tsoumakas, G. & Katakis, I. %D 2007 %T Multi Label Classification: An Overview %E %B International Journal of Data Warehouse and Mining %C %I Idea Group Publishing %V 3 %6 %N 3 %P 1--13 %& %Y %S %7 %8 %9 %? %! %Z %@ %( %) %* %L %M %1 %2 CiteULike: Multi Label Classification: An Overview %3 article %4 %# %$ %F citeulike:2146554 %K classification, learning, machine, ml, multi_label, survey %X Nowadays, multi-label classification methods are increasingly required by modern applications, such as protein function classification, music categorization and semantic scene classification. This paper introduces the task of multi-label classification, organizes the sparse related literature into a structured presentation and performs comparative experimental results of certain multi-label classification methods. It also contributes the definition of concepts for the quantification of the multi-label nature of a data set. %Z %U %+ %^ %0 %0 Conference Proceedings %A Ciravegna, Fabio & Chapman, Sam %D 2005 %T Mining the Semantic Web: Requirements for machine learning %E %B Proceedings of the Dagstuhl Seminar in Machine Learning for the Semantic Web %C %I %V %6 %N %P %& %Y %S %7 %8 February %9 %? %! %Z %@ %( %) %* %L %M %1 %2 %3 inproceedings %4 %# %$ %F Chapman05b %K web, learning, ontology, knowledge, population, integration, semantic, machine, acquisition %X %Z %U http://www.smi.ucd.ie/Dagstuhl-MLSW/proceedings/ciravegna-chapman.pdf %+ %^ %0 %0 Manuscript %A McCallum, Andrew Kachites %D 2002 %T MALLET: A Machine Learning for Language Toolkit %E %B %C %I %V %6 %N %P %& %Y %S %7 %8 %9 %? %! %Z %@ %( %) %* %L %M %1 %2 %3 unpublished %4 %# %$ %F McCallumMALLET %K extraction, learning, information, mallet, machine %X %Z http://mallet.cs.umass.edu %U http://mallet.cs.umass.edu %+ %^ %0 %0 Book %A Thrun, Sebastian; Burgard, Wolfram & Fox, Dieter %D 2001 %T Probabilistic Robotics (Intelligent Robotics and Autonomous Agents) %E %B %C %I %V %6 %N %P %& %Y %S %7 %8 %9 %? %! %Z %@ %( %) %* %L %M %1 %2 Amazon.com: Probabilistic Robotics (Intelligent Robotics and Autonomous Agents): Books: Sebastian Thrun,Wolfram Burgard,Dieter Fox %3 book %4 %# %$ %F thrun2001 %K dm, learning, machine, ml, probabilistic %X %Z %U http://www.amazon.com/Probabilistic-Robotics-Intelligent-Autonomous-Agents/dp/0262201623/ref=sr_11_1/105-3361811-4085215?ie=UTF8&qid=1190743235&sr=11-1 %+ %^ %0 %0 Book Section %A Leake, David B. %D 2000 %T Case-based reasoning %E Ralston, Anthony; Reilly, Edwin D. & Hemmendinger, David %B Encyclopedia of Computer Science %C Chichester, UK %I John Wiley and Sons Ltd. %V %6 %N %P 196--197 %& %Y %S %7 4th %8 June %9 %? %! %Z %@ 0-470-86412-5 %( %) %* %L %M %1 %2 %3 incollection %4 %# %$ %F leake2000casebased %K based, case, cbr, learning, machine, ml, reasoning %X Case-based reasoning(CBR) is an artificial intelligence paradigm for reasoning and learning. Case-based reasoning solves new problems by retrieving stored records of prior problem-solving episodes (cases) and adapting their solutions to fit new circumstances. Each processing episode provides a new case that is stored for future reuse, making learning a natural side-effect of the reasoning process. Case-based reasoning is also studied within cognitive science as a model of human reasoning: studies show that people use recollections of prior problems to guide their reasoning in a wide range of tasks, such as programming, mathematical problem solving, diagnosis, decision making, and design. %Z %U http://dl.acm.org/citation.cfm?id=1074100.1074199 %+ %^ %0 %0 Generic %A Newman, C.L. Blake D.J. & Merz, C.J. %D 1998 %T UCI Repository of machine learning databases %E %B %C %I %V %6 %N %P %& %Y %S %7 %8 %9 %? %! %Z %@ %( %) %* %L %M %1 %2 UCI Machine Learning Repository %3 misc %4 %# %$ %F Newman+Hettich+Blake+Merz:1998 %K learning, data, dataset, dm, mining, machine, ml, uci %X %Z %U http://www.ics.uci.edu/$\sim$mlearn/MLRepository.html %+ %^ %0 %0 Conference Proceedings %A Cohen, William W. & Hirsh, Haym %D 1994 %T Learning the Classic Description Logic: Theoretical and Experimental Results. %E %B KR %C %I %V %6 %N %P 121-133 %& %Y %S %7 %8 %9 %? %! %Z %@ 1-55860-554-1 %( %) %* %L %M %1 %2 dblp %3 inproceedings %4 %# %$ %F conf/kr/CohenH94 %K learning, logic, description, machine, ml, dl %X %Z %U http://www.cs.cmu.edu/~wcohen/postscript/kr-94.ps %+ %^ %0 %0 Journal Article %A Cohen, William W. & Hirsh, Haym %D 1994 %T The Learnability of Description Logics with Equality Constraints. %E %B Machine Learning %C %I %V 17 %6 %N 2-3 %P 169-199 %& %Y %S %7 %8 %9 %? %! %Z %@ %( %) %* %L %M %1 %2 dblp %3 article %4 %# %$ %F journals/ml/CohenH94 %K learning, logic, description, machine, ml, dl %X %Z %U http://www.cs.cmu.edu/~wcohen/postscript/kr-94.ps %+ %^ %0 %0 Book %A Sowa, J. F. %D 1984 %T Conceptual Structures: Information Processing in Mind and Machine %E %B %C Reading, MA %I Addison-Wesley Publishing Company %V %6 %N %P %& %Y %S %7 %8 %9 %? %! %Z %@ %( %) %* %L %M %1 %2 %3 book %4 %# %$ %F sowa84 %K processing, information, structures, machine, mind, conceptual %X %Z %U %+ %^