人工智能原理Lecture-8-生成性对抗网络-课件.pptx
- 【下载声明】
1. 本站全部试题类文档,若标题没写含答案,则无答案;标题注明含答案的文档,主观题也可能无答案。请谨慎下单,一旦售出,不予退换。
2. 本站全部PPT文档均不含视频和音频,PPT中出现的音频或视频标识(或文字)仅表示流程,实际无音频或视频文件。请谨慎下单,一旦售出,不予退换。
3. 本页资料《人工智能原理Lecture-8-生成性对抗网络-课件.pptx》由用户(三亚风情)主动上传,其收益全归该用户。163文库仅提供信息存储空间,仅对该用户上传内容的表现方式做保护处理,对上传内容本身不做任何修改或编辑。 若此文所含内容侵犯了您的版权或隐私,请立即通知163文库(点击联系客服),我们立即给予删除!
4. 请根据预览情况,自愿下载本文。本站不保证下载资源的准确性、安全性和完整性, 同时也不承担用户因使用这些下载资源对自己和他人造成任何形式的伤害或损失。
5. 本站所有资源如无特殊说明,都需要本地电脑安装OFFICE2007及以上版本和PDF阅读器,压缩文件请下载最新的WinRAR软件解压。
- 配套讲稿:
如PPT文件的首页显示word图标,表示该PPT已包含配套word讲稿。双击word图标可打开word文档。
- 特殊限制:
部分文档作品中含有的国旗、国徽等图片,仅作为作品整体效果示例展示,禁止商用。设计者仅对作品中独创性部分享有著作权。
- 关 键 词:
- 人工智能 原理 Lecture 生成 对抗 网络 课件
- 资源描述:
-
1、Lecture 8: GenerativeAdversarial Network2November 27, 2019Artificial IntelligenceGenerative Adversarial Networks Genarative Learn a generative model Adversarial Trained in an adversarial setting Networks Use Deep Neural NetworksArtificial Intelligence3Generative ModelsNovember 27, 2019Artificial Int
2、elligence4Generative ModelsNovember 27, 2019Artificial Intelligence5Why Generative Models? Discriminative models Given a image X, predict a label Y Estimates P(Y|X) Discriminative models limitations: Cant model P(X) Cant generate new images Generative models Can model P(X) Can generate new imagesNov
3、ember 27, 2019Artificial Intelligence6Magic of GANsNovember 27, 2019Artificial Intelligence7Magic of GANs Which one is Computer generated?November 27, 2019Artificial Intelligence8Magic of GANsNovember 27, 2019Artificial Intelligence9GANs ArchitectureNovember 27, 2019Artificial Intelligence10November
4、 27, 2019Adversarial TrainingAdversarial Samples:We can generate adversarial samples to fool a discriminative modelWe can use those adversarial samples to make models robustWe then require more effort to generate adversarial samplesRepeat this and we get better discriminative modelGANs extend that i
5、dea to generative models:Generator: generate fake samples, tries to fool the DiscriminatorDiscriminator: tries to distinguish between real and fake samplesTrain them against each otherRepeat this and we get better Generator and DiscriminatorArtificial Intelligence11Training DiscriminatorNovember 27,
6、 2019Artificial Intelligence12Training GeneratorNovember 27, 2019Artificial Intelligence13Mathematical formulationNovember 27, 2019Artificial Intelligence14Mathematical formulationNovember 27, 2019Artificial Intelligence15Mathematical formulationNovember 27, 201916November 27, 2019Artificial Intelli
7、genceMathematical formulationArtificial Intelligence17Advantages of GANsNovember 27, 2019Artificial Intelligence18Problems with GANsNovember 27, 2019Artificial Intelligence19Problems with GANsNovember 27, 2019Artificial Intelligence20November 27, 2019FormulationDeep Learning models (in general) invo
8、lve a single playerThe player tries to maximize its reward (minimize its loss).Use SGD (with Backpropagation) to find the optimal parameters.SGD has convergence guarantees (under certain conditions).Problem: With non-convexity, we might converge to local optima.Artificial Intelligence21November 27,
9、2019FormulationGANs instead involve two (or more) playersDiscriminator is trying to maximize its reward.Generator is trying to minimize Discriminators reward.SGD was not designed to find the Nash equilibrium of a game.Problem: We might not converge to the Nash equilibrium at all.22November 27, 2019A
10、rtificial IntelligenceNon-ConvergenceArtificial Intelligence23Problems with GANsNovember 27, 2019Artificial Intelligence24Mode-CollapseNovember 27, 2019Artificial Intelligence25Some Real ExamplesNovember 27, 2019Artificial Intelligence26Some Solutions Mini-Batch GANs Supervision with labels Some rec
11、ent attempts : Unrolled GANs W-GANsNovember 27, 2019Artificial Intelligence27Basic (Heuristic) Solutions Mini-Batch GANs Supervision with labelsNovember 27, 201928November 27, 2019Artificial IntelligenceHow to reward sample diversity?At Mode Collapse,Generator produces good samples, but a very few o
展开阅读全文