Don't know about permits but the speed limit is very slow and the beach is small. You'll notice every tow truck in town is 4wd. No where else in NC is it like that. Not even in the mountains where we have big snow falls.
Reid,
Here's some links:
http://www.wilmingtonandbeaches.com/Kure-Beach
It is south of Wilmington on the point. Google map:
http://goo.gl/maps/1IIaO
Check out the NC Aquarium and Fort Fisher. You can also catch a ferry to the mainland (Southport?) and ride down to Oak Island, Holden Beach and on to Calabash where there's about 200 of the best seafood restaurants in the world. Take you're pick. They're all good. Some of the Calabash seafood restaurants have their own piers and fishing boats and are built overlooking the water.
Don't forget, there's alligators in some of the inland backwaters there. Usually a couple of gators can be seen swimming around the USS North Carolina docked in Wilmington.
Usually good fishing up north around Topsail but with luck any of the piers can get lucky especially in the fall.
Be careful on the drawbridge in Wilmington. The dumbasses who built it turned the grates at an angle to the direction of travel and your bike will want to follow the grates. It's like that thing some bikes do when crossing lines in the road except worse. Slow down on those metal bridges and let the traffic back up behind you. They'll get over slowing down, you might not get over going down on the bridge.
I can't speak as to great roads to ride down there but there are lots of great destinations.
Oh, and DADDYGCYCLES, in another thread you once asked why folks down south pull to the side in big rain storms? It's called golf ball sized hail. It comes out of nowhere, can be very localized and will knock the windshield right out of your car or truck. Insurance companies actually total loss vehicles for hail damage down here every summer. I've seen hail penetrate metal awnings. The hotter the weather the bigger the hail stones. It's always hidden in heavy rain and you never see it 'til the glass starts breaking so those of us who are from here just pull over and wait a few minutes for things to calm down rather than risk getting hit in the head by giant pieces of ice. It's a local thing that we don't usually tell Yankees but since you ride I made an exception.