My husband was scared too on how much it cost as well. You should ask him what he feels comfortable with. You already know he wants to be with you so maybe a good conversation will help figure things out.
I agree with the others. You don't need to spend a lot. City hall is a perfectly good venue. Choose the nicest dress you have or hit Value Village or Salvation Army for some great prices. You could serve coffee and cake at your own house, or a family member's place, and save a ton of money. Costco has a nice slab cake for $20.00 and they have an anniversary cake that could be made to look like a wedding cake. Pick flowers from the garden or, with permission, someone else's garden. If you can get some help from family and friends, you could do potluck with hot or cold food like fancy sandwiches, salads, veggies and dip, meatballs and rice, etc. You could probably do it for under $600.00! I am the world's most frugal bride. Contact me if you want more tips.