Point-Based Neural Rendering with Per-View Optimization