ex) Tic-Tac-Toe Assign value to each board position (state): +1 if the state is a winning terminal state. 0 if the state is a losing terminal state +0.5 to all other states (terminal and non–terminal) play many games After each move, adjust the value of the pr…
From today, we are going to introduce reinforcement learning(RL). Forget ANNs for a while - RL is a field in its own right, independent from ANNs. However, as we will see, ANNs are sometimes used in RL. Definition: Learning by interaction with an environment, …
In this course, we learn more on extensions. and prior knowledge. We want to minimize the number of hidden nodes(=> less overfitting) The approaches: start with a large networks and prune. start with a small networks and grow. There are two example. Let eac…
Let's continue talk about overtraining. The number of training set samples should be much larger than the number of weights roughly for \(N^2\)(N = the number of weights). minimize the number of nodes and layers(weights) noise injection and noise to the…
in order to decide by how much of the result blamed or credited to a particular weight. We need sigmoid function. Sigmoid function = any S-shape function. examples. logistical function \( y=f(s)=\frac{1}{1+e^{- \lambda s}} \), \(\lambda\) decides slope. When \…
This course, I learnt basic pattern recognition , perceptron and an overview of how to train/adjust the perceptron. Here are some basic terms we should know. pattern recognition = feature extraction + classification Feature extraction = find "good" f…
A question, what is AI? Artificial Intelligence: It is not the art of making computers behave as they do in the movies. It is motivated by the brain, but do not overdo it. We always regard it as a black box. After opening this box, we can see a network of simp…
I am going to record my course notes for a basic machine learning course, Natural Computation Methods for Machine Learning ( 1DL073 ). There are some course notes and personal understanding. I will not show full slides and provide the e-book of literature. How…
python3.6 cudnn7.1.3 keras和tensorflow graphviz Opencv 阿里云 弗吉尼亚地区 ecs.gn5-c4g1.xlarge型号 OS:ubuntu 16.04 CPU: 4 vCPU GPU: Nvidia P100 (12 GiB 显存) sudo apt-get install -y software-properties-common sudo add-apt-repository ppa:deadsnakes/ppa sudo apt-get update su…
准备前提： 1.一台远程主机，工作站/VPS/服务器/阿里云ECS 2.一台安装了Pycharm professional的笔记本/超极本/surface 3. Putty和puttygen(强烈建议从官网直接下载，不要使用第三方下载工具，为了你的安全) 步骤： 1.获取你的VPS的IP，你可以从你的IDC获取，或者向你的实验室老师/老板/IT索取： 2.使用putty登陆 3.登陆成功 4.使用puttygen生成…
