My little guy did that when I first brought him home at only three pounds. The gate wasn't nearly as high...but I feel he would have climbed it no matter what. I tried covering it too. After three days of him escaping...I felt he earned the right to be free in the house...except for the bedrooms and bathroom. I also thought about changing his name to Houdini.
