夏天蓝车-CSDN博客

原创毕业论文【2】——DQN

算法的核心是数学和数据结构，手动模拟一遍算法，弄懂算法的内在含义，就能从里向外给关于此算法的内容加上“华丽的言词”。开始正文了接触DQN后，我的想法就是Q表格更新出大量样本，紧接着使用样本训练神经网络，待其收敛后，使用神经网络替代Q。由于这种方式很好理解，一时间，它在我脑里根深蒂固，但我发现我和刘建平刘老师的算法步骤根本对不上，我反复阅读博客，读原paper，终究不得其解，急得我满头大汗，我甚至怀疑我自己了。下午吃完饭前，在刘老师的博客评论里找到了我的救药，原来是我没弄懂DRL的真正含义！！

2021-03-08 20:08:55 579 4

原创毕业论文【1】——Q-Learning

毕业论文选题是"强化学习在路径规划中的应用"，就在博客中记录一下研究历程吧。先学的是强化学习的经典算法——Q-Learning看了这么多博客介绍，对Q-Learning算法也有了一定的认知。我从国外一学生的个人博客中，找到了一篇关于Q-Learning的介绍和推导，大概发布于2010年左右，读完他的博客，我豁然开朗。这位作者确实有很强的计算机思想，他告诉我，Q-Learning本质上是一个带权有向图据权值随节点移动的问题，如此重要的强化学习算法，背后原理却是最简单的“图”问题，正是这一点让我

2021-03-04 22:34:35 852 2

原创 1769. Minimum Number of Operations to Move All Balls to Each Box

You havenboxes. You are given a binary stringboxesof lengthn, whereboxes[i]is'0'if theithbox isempty, and'1'if it containsoneball.In one operation, you can moveoneball from a box to an adjacent box. Boxiis adjacent to boxjifabs(i -...

2021-02-28 21:36:44 144

原创 1754. Largest Merge Of Two Strings

You are given two stringsword1andword2. You want to construct a stringmergein the following way: while eitherword1orword2are non-empty, chooseoneof the following options:Ifword1is non-empty, append thefirstcharacter inword1tomergeand d...

2021-02-28 20:57:18 157

原创 1753. Maximum Score From Removing Stones

You are playing a solitaire game withthree pilesof stones of sizesa,b, andc respectively. Each turn you choose twodifferent non-emptypiles, take one stone from each, and add1point to your score. The game stops when there arefewe...

2021-02-27 18:44:48 149

原创 1706. Where Will the Ball Fall

You have a 2-Dgridof sizem x nrepresenting a box, and you havenballs. The box is open on the top and bottom sides.Each cell in the box has a diagonal board spanning two corners of the cell that can redirect a ball to the right or to the left.A bo...

2021-02-27 15:52:48 214

原创 1765. Map of Highest Peak

You are given an integer matrixisWaterof sizem x nthat represents a map oflandandwatercells.IfisWater[i][j] == 0, cell(i, j)is alandcell. IfisWater[i][j] == 1, cell(i, j)is awatercell.You must assign each cell a height in a way that f...

2021-02-27 10:18:36 172

原创 1716. Calculate Money in Leetcode Bank

Hercy wants to save money for his first car. He puts money in the Leetcodebankevery day.He starts by putting in$1on Monday, the first day. Every day from Tuesday to Sunday, he will put in$1more than the day before. On every subsequent Monday, he wi...

2021-02-26 15:55:14 159

原创 1678. Goal Parser Interpretation

You own aGoal Parserthat can interpret a stringcommand. Thecommandconsists of an alphabet of"G","()"and/or"(al)"in some order. The Goal Parser will interpret"G"as the string"G","()"as the string"o", and"(al)"as the string"al". The interp...

2021-02-26 14:59:45 214

原创 1720. Decode XORed Array

There is ahiddeninteger arrayarrthat consists ofnnon-negative integers.It was encoded into another integer arrayencodedof lengthn - 1, such thatencoded[i] = arr[i] XOR arr[i + 1]. For example, ifarr = [1,0,2,1], thenencoded = [1,2,3].You ar...

2021-02-25 19:49:28 119

原创 1752. Check if Array Is Sorted and Rotated

Given an arraynums, returntrueif the array was originally sorted in non-decreasing order, then rotatedsomenumber of positions (including zero). Otherwise, returnfalse.There may beduplicatesin the original array.Note:An arrayArotated byxpos...

2021-02-25 19:22:05 83

原创 1748. Sum of Unique Elements

You are given an integer arraynums. The unique elements of an array are the elements that appearexactly oncein the array.Returnthesumof all the unique elements ofnums.Example 1:Input: nums = [1,2,3,2]Output: 4Explanation: The unique elem...

2021-02-25 17:43:21 134

原创 1725. Number Of Rectangles That Can Form The Largest Square

You are given an arrayrectangleswhererectangles[i] = [li, wi]represents theithrectangle of lengthliand widthwi.You can cut theithrectangle to form a square with a side length ofkif bothk <= liandk <= wi. For example, if you have a r...

2021-02-25 16:47:47 147

原创 1742. Maximum Number of Balls in a Box

You are working in a ball factory where you havenballs numbered fromlowLimitup tohighLimitinclusive(i.e.,n == highLimit - lowLimit + 1), and an infinite number of boxes numbered from1toinfinity.Your job at this factory is to put each ball in t...

2021-02-25 15:32:35 126

原创 1758. Minimum Changes To Make Alternating Binary String

You are given a stringsconsisting only of the characters'0'and'1'. In one operation, you can change any'0'to'1'or vice versa.The string is called alternating if no two adjacent characters are equal. For example, the string"010"is alternating, ...

2021-02-25 14:50:08 70

原创 1736. Latest Time by Replacing Hidden Digits

You are given a stringtimein the form ofhh:mm, where some of the digits in the string are hidden (represented by?).The valid times are those inclusively between00:00and23:59.Returnthe latest valid time you can get fromtimeby replacing the hid...

2021-02-25 14:25:18 92

原创 1763. Longest Nice Substring

A stringsisniceif, for every letter of the alphabet thatscontains, it appearsbothin uppercase and lowercase. For example,"abABB"is nice because'A'and'a'appear, and'B'and'b'appear. However,"abA"is not because'b'appears, but'B'does no...

2021-02-25 12:37:54 427

原创 1768. Merge Strings Alternately

You are given two stringsword1andword2. Merge the strings by adding letters in alternating order, starting withword1. If a string is longer than the other, append the additional letters onto the end of the merged string.Returnthe merged string....

2021-02-25 08:45:42 159

原创 1732. Find the Highest Altitude

There is a biker going on a road trip. The road trip consists ofn + 1points at different altitudes. The biker starts his trip on point0with altitude equal0.You are given an integer arraygainof lengthnwheregain[i]is thenet gain in altitudebet...

2021-02-24 20:02:49 143

weixin_42447161的博客